【问题标题】:zookeeper unexpected exception causing shutdown while sock still openzookeeper意外异常导致sock仍然打开时关闭
【发布时间】:2016-04-14 11:27:27
【问题描述】:

我在 Cloudera Hadoop 2.0 集群中遇到了很多重大问题,这些问题与 Zookeeper 上每天发生多次的以下错误相吻合。

我无法找到问题的根本原因。

感谢任何帮助。

2016-04-11 14:48:30,872 ERROR org.apache.zookeeper.server.quorum.LearnerHandler: Unexpected exception causing shutdown while sock still open 2016-04-11 14:48:49,584 ERROR org.apache.zookeeper.server.quorum.LearnerHandler: Unexpected exception causing shutdown while sock still open 2016-04-11 14:49:07,239 ERROR org.apache.zookeeper.server.quorum.LearnerHandler: Unexpected exception causing shutdown while sock still open 2016-04-11 14:49:25,291 ERROR org.apache.zookeeper.server.quorum.LearnerHandler: Unexpected exception causing shutdown while sock still open 2016-04-11 14:49:42,779 ERROR org.apache.zookeeper.server.quorum.LearnerHandler: Unexpected exception causing shutdown while sock still open 2016-04-11 14:50:00,613 ERROR org.apache.zookeeper.server.quorum.LearnerHandler: Unexpected exception causing shutdown while sock still open 2016-04-11 14:50:17,976 ERROR org.apache.zookeeper.server.quorum.LearnerHandler: Unexpected exception causing shutdown while sock still open 2016-04-11 14:50:35,957 ERROR org.apache.zookeeper.server.quorum.LearnerHandler: Unexpected exception causing shutdown while sock still open 2016-04-11 14:50:54,676 ERROR org.apache.zookeeper.server.quorum.LearnerHandler: Unexpected exception causing shutdown while sock still open

【问题讨论】:

标签: hadoop apache-zookeeper hadoop-yarn cloudera


【解决方案1】:

原来是 2 层问题:

在leader选举时间过长时发生上述错误。

leader 选举耗时过长的原因是 3 个 zookeeper 服务器之一上的数据损坏。

一旦 /var/lib/zookeeper 中的数据文件被炸毁,zookeeper 重新启动,leader 选举成功,进而停止了上述问题。

【讨论】:

    猜你喜欢
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2015-06-25
    • 1970-01-01
    相关资源
    最近更新 更多