【发布时间】：2019-08-20 01:33:48
【问题描述】：
在 Centos 7 上运行 HBase 2.0.4 和 Hadoop 2.8.5，具有 1 个主节点，4 个从节点。我用 HBase 2.1.3 尝试了相同的设置，但出现了同样的问题。
从这个错误日志可以看出，由于 Zookeeper 没有解析 HRegionservers，HMaster 无法启动。
2019-03-29 13:58:34,961 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=node0.ken:2181, node1.ken:2181, node2.ken:2181, node3.ken:2181, node4.ken:21
81 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@165e389b
2019-03-29 13:58:34,965 WARN [main] zookeeper.RecoverableZooKeeper: Unable to create ZooKeeper Connection
java.net.UnknownHostException: node1.ken: Name or service not known
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:929)
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1324)
at java.net.InetAddress.getAllByName0(InetAddress.java:1277)
at java.net.InetAddress.getAllByName(InetAddress.java:1193)
at java.net.InetAddress.getAllByName(InetAddress.java:1127)
at org.apache.zookeeper.client.StaticHostProvider.<init>(StaticHostProvider.java:61)
at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:445)
at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380)
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.checkZk(RecoverableZooKeeper.java:131)
我的配置文件如下所示：
---- hbase-site.xml ----
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://node0.ken:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>zookeeper.session.timeout</name>
<value>1200000</value>
</property>
<property>
<name>hbase.zookeeper.session.timeout</name>
<value>1200000</value>
</property>
<property>
<name>hbase.zookeeper.property.tickTime</name>
<value>6000</value>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>hdfs://node0.ken:9000/zookeeper</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>node0.ken, node1.ken, node2.ken, node3.ken, node4.ken</value>
</property>
<property>
<name>hbase.zookeeper.property.clientPort</name>
<value>2181</value>
</property>
<property>
<name>zookeeper.znode.parent</name>
<value>/node0.ken</value>
</property>
</configuration>
---- 区域服务器 ----
node1.ken
node2.ken
node3.ken
node4.ken
---- /etc/hosts ----
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
#::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
10.158.57.150 node0.ken node0 master-node
10.158.57.151 node1.ken node1
10.158.57.152 node2.ken node2
10.158.57.153 node3.ken node3
10.158.57.154 node4.ken node4
所有主机都可以相互ping通，SELinux和firewalld被禁用，我能够从所有其他节点成功telnet node1:2181，我已经尝试过这里建议的步骤，但Zookeeper仍然无法解决：@ 987654321@
我错过了什么吗？ Zookeeper 还从哪里提取主机分辨率？
更新：2019-03-29
问题似乎是 HBase 使用的 Zookeeper 客户端（zookeeper.version=3.4.10），可能与此错误有关：https://issues.apache.org/jira/browse/ZOOKEEPER-2982 有谁知道如何用更新的版本替换 Zookeeper 客户端 HBase 使用的？
更新：2019-04-01
我尝试用hbase/lib/zookeeper-3.4.13.jar 替换hbase/lib/zookeeper-3.4.10.jar，输出相同的错误，只是来自不同的API 调用：
2019-03-29 19:09:46,880 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=node0.ken:2181, node1.ken:2181, node2.ken:2181, node3.ken:2181, node4.ken:2181 sessionTimeout=1200000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@336880df
2019-03-29 19:09:46,912 INFO [main-SendThread( node1.ken:2181)] zookeeper.ClientCnxn: Opening socket connection to server node1.ken:2181. Will not attempt to authenticate using SASL (unknown error)
2019-03-29 19:09:46,917 WARN [main-SendThread( node1.ken:2181)] zookeeper.ClientCnxn: Session 0x0 for server node1.ken:2181, unexpected error, closing socket connection and attempting reconnect
java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Net.java:101)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:622)
at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:277)
at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:287)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1021)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1064)
我尝试编译一个小的 Java 类来测试这些功能：
import java.net.InetAddress;
import java.net.InetSocketAddress;
import java.net.SocketAddress;
import java.net.Socket;
import sun.nio.ch.Net;
import java.net.UnknownHostException;
import java.io.IOException;
import java.util.Arrays;
import java.util.List;
public class GetIPHostname {
public static void main(String[] args) {
InetAddress ip;
String hostname;
try {
ip = InetAddress.getLocalHost();
hostname = ip.getHostName();
System.out.println("Your current IP address : " + ip);
System.out.println("Your current Hostname : " + hostname);
//List<String> hostname_list = Arrays.asList("node0", "node1", "node2", "node3", "node4");
List<String> hostname_list = Arrays.asList("node0.ken", "node1.ken", "node2.ken", "node3.ken", "node4.ken");
for (String cur_hostname : hostname_list) {
String ip_address = InetAddress.getByName(cur_hostname).getHostAddress();
System.out.println("Hostname resolved: "+cur_hostname+" -> "+ip_address);
final Socket socket = new Socket();
SocketAddress address = new InetSocketAddress(cur_hostname, 2181);
try {
InetSocketAddress isa = Net.checkAddress(address);
System.out.println("ISA: " +isa.getAddress()+ " -> " +isa.getPort());
InetAddress[] iadresses= InetAddress.getAllByName(cur_hostname);
for (InetAddress cur_ia : iadresses) {
System.out.println("InetAddress: " + cur_ia.getHostAddress());
}
socket.connect(address);
socket.close();
} catch (IOException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}// To connect to remote host
}
} catch (UnknownHostException e) {
e.printStackTrace();
}
}
}
...两个 API 都可以使用 hosts 文件解析地址，甚至可以连接到 Zookeeper 服务器的 2181 端口：
[root@node1 test]# java GetIPHostname
Your current IP address : node1.ken/10.158.57.151
Your current Hostname : node1.ken
Hostname resolved: node0.ken -> 10.158.57.150
ISA: node0.ken/10.158.57.150 -> 2181
InetAddress: 10.158.57.150
Hostname resolved: node1.ken -> 10.158.57.151
ISA: node1.ken/10.158.57.151 -> 2181
InetAddress: 10.158.57.151
Hostname resolved: node2.ken -> 10.158.57.152
ISA: node2.ken/10.158.57.152 -> 2181
InetAddress: 10.158.57.152
Hostname resolved: node3.ken -> 10.158.57.153
ISA: node3.ken/10.158.57.153 -> 2181
InetAddress: 10.158.57.153
Hostname resolved: node4.ken -> 10.158.57.154
ISA: node4.ken/10.158.57.154 -> 2181
InetAddress: 10.158.57.154
【问题讨论】：