【发布时间】:2015-02-23 10:17:29
【问题描述】:
我们安装了一个包含 3 台机器的小型 Hadoop 集群。我们正在使用 Hortonworks。
我们使用以下代码从java客户端连接到Hbase。
Configuration config = HBaseConfiguration.create()
config.set(“hbase.zookeeper.quorum”, “xxxxxx”);
config.set(“hbase.zookeeper.property.clientPort”, “2181”);
config.set(“hbase.client.operation.timeout”, “1000”);
HConnection connection =HConnectionManager.createConnection(config);
HTableInterface hTable = connection.getTable(tableName);
但不知何故,Hbase 区域服务器会在一段时间后自动关闭,并出现以下错误。
2015-02-23 03:38:49,472 WARN [regionserver60020] zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper, quorum=ip-10-174-18-85.ap-southeast-1.compute.internal:2181,ip-10-149-130-178.ap-southeast-1.compute.internal:2181,ip-10-174-28-180.ap-southeast-1.compute.internal:2181, exception=org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/ip-10-174-28-180.ap-southeast-1.compute.internal,60020,1424680062858
2015-02-23 03:38:49,472 ERROR [regionserver60020] zookeeper.RecoverableZooKeeper: ZooKeeper delete failed after 4 attempts
2015-02-23 03:38:49,472 WARN [regionserver60020] regionserver.HRegionServer: Failed deleting my ephemeral node
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/ip-10-174-28-180.ap-southeast-1.compute.internal,60020,1424680062858
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.delete(RecoverableZooKeeper.java:156)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1270)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1259)
at org.apache.hadoop.hbase.regionserver.HRegionServer.deleteMyEphemeralNode(HRegionServer.java:1286)
at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1016)
at java.lang.Thread.run(Thread.java:744)
2015-02-23 03:39:10,233 INFO [regionserver60020] regionserver.HRegionServer: stopping server ip-10-174-28-180.ap-southeast-1.compute.internal,60020,1424680062858; zookeeper connection closed.
2015-02-23 03:39:10,233 INFO [regionserver60020] regionserver.HRegionServer: regionserver60020 exiting
2015-02-23 03:39:10,236 ERROR [main] regionserver.HRegionServerCommandLine: Region server exiting
java.lang.RuntimeException: HRegionServer Aborted
at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:66)
at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:85)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2403)
2015-02-23 03:39:10,240 INFO [Thread-11] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@abde0e7
我尝试将 regionserver 的 JVM Heap 大小增加到 2GB,并将会话超时时间增加到 60 秒。但似乎没有任何帮助。
请帮忙解决问题??
【问题讨论】:
标签: java hadoop hbase apache-zookeeper