【问题标题】:HBASE distributed mode on HADOOP stuckHADOOP 上的 HBASE 分布式模式卡住了
【发布时间】:2018-08-18 08:56:19
【问题描述】:

我正在尝试在 3 节点 hadoop 集群上配置 HBASE 分布式模式。

问题是当我开始 start-all-sh 时,

我的光标在写完后卡住了

hadoop@namenode1:/usr/local/hbase/bin$ start-hbase.sh
hadoop@namenode1's password: datanode2: starting zookeeper, logging to /usr/local/hbase/bin/../logs/hbase-hadoop-zookeeper-datanode2.out
datanode1: starting zookeeper, logging to /usr/local/hbase/bin/../logs/hbase-hadoop-zookeeper-datanode1.out

而且它没有进一步进行。有点卡住了。

我的 hbase.site.xml

`<configuration>

  <property>
    <name>hbase.rootdir</name>
    <value>hdfs://namenode1:10001/hbase</value>
  </property>

   <property>
    <name>hbase.cluster.distributed</name>
    <value>true</value>
  </property>

  <property>
    <name>hbase.zookeeper.property.dataDir</name>
    <value>hdfs://namenode1:10001/zookeeper</value>
  </property>

  <property>
    <name>hbase.zookeeper.quorum</name>
    <value>namenode1,datanode1,datanode2</value>
  </property>

  <property>
    <name>hbase.zookeeper.property.clientPort</name>
    <value>2181</value>
  </property>

</configuration>
`

但是我没有单独安装zookeeper

我的数据节点显示

4387 Jps
3978 DataNode
4332 HQuorumPeer
4126 NodeManager

名称节点只显示

`hadoop@namenode1:/usr/local/hbase/conf$ jps
4832 ResourceManager
4676 SecondaryNameNode
4443 NameNode
5437 Jps`

请帮助解决问题。我被困住了。

现在当我在光标上按回车时

hadoop@namenode1:/usr/local/hbase/bin$ start-hbase.sh
hadoop@namenode1's password: datanode2: starting zookeeper, logging to /usr/local/hbase/bin/../logs/hbase-hadoop-zookeeper-datanode2.out
datanode1: starting zookeeper, logging to /usr/local/hbase/bin/../logs/hbase-hadoop-zookeeper-datanode1.out

namenode1: Connection closed by UNKNOWN
starting master, logging to /usr/local/hbase/logs/hbase-hadoop-master-namenode1.out
hadoop@namenode1's password: datanode2: starting regionserver, logging to /usr/local/hbase/bin/../logs/hbase-hadoop-regionserver-datanode2.out
datanode1: starting regionserver, logging to /usr/local/hbase/bin/../logs/hbase-hadoop-regionserver-datanode1.out

hadoop@namenode1's password: namenode1: Permission denied, please try again.

hadoop@namenode1's password: namenode1: Permission denied, please try again.

namenode1: Permission denied (publickey,password).

然后namenode显示

hadoop@namenode1:/usr/local/hbase/bin$ jps
4832 ResourceManager
4676 SecondaryNameNode
5559 HMaster
5751 Jps
4443 NameNode

和datanode1显示

hadoop@datanode1:/usr/local/hbase/conf$ jps
4610 Jps
4502 HRegionServer
3978 DataNode
4332 HQuorumPeer
4126 NodeManager

和datanode2显示

hadoop@datanode2:~$ jps
2465 DataNode
2601 NodeManager
2922 HRegionServer
2794 HQuorumPeer
3054 Jps

【问题讨论】:

  • 你配置了无密码的ssh吗?
  • 是的,我在所有节点之间添加了无密码 ssh,但尝试登录同一台机器时失败。
  • 感谢@Abhinav。我从你的回复中得到了提示

标签: hadoop hbase apache-zookeeper


【解决方案1】:

其实我首先需要在分布式模式下安装zookeeper

对于无密码 ssh 我没有配置 self ssh passwordless

就这样跑了

sudo cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

感谢@Abhinav 伙计们

【讨论】:

    猜你喜欢
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多