【问题标题】:ERROR when run start-dfs.sh in Hadoop-3.2.0在 Hadoop-3.2.0 中运行 start-dfs.sh 时出错
【发布时间】:2020-05-27 16:50:08
【问题描述】:

我在 Hadoop3.2.1 的配置中遇到了一些问题,用于 YARN 学习。而且我在运行sbin/start-all.sh的时候发现用户root和用户host1有两种不同的情况。你能告诉我如何解决它以及它是否与SSH连接?非常感谢。

在根目录中:

root@host1-virtual-machine:/home/host1/usr/hadoop-3.2.1# sbin/start-all.sh
Starting namenodes on [localhost]
ERROR: Attempting to operate on hdfs namenode as root
ERROR: but there is no HDFS_NAMENODE_USER defined. Aborting operation.
Starting datanodes
ERROR: Attempting to operate on hdfs datanode as root
ERROR: but there is no HDFS_DATANODE_USER defined. Aborting operation.
Starting secondary namenodes [host1-virtual-machine]
ERROR: Attempting to operate on hdfs secondarynamenode as root
ERROR: but there is no HDFS_SECONDARYNAMENODE_USER defined. Aborting operation.
2020-02-12 14:40:27,093 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting resourcemanager
ERROR: Attempting to operate on yarn resourcemanager as root
ERROR: but there is no YARN_RESOURCEMANAGER_USER defined. Aborting operation.
Starting nodemanagers
ERROR: Attempting to operate on yarn nodemanager as root
ERROR: but there is no YARN_NODEMANAGER_USER defined. Aborting operation.

在 host1 用户中:

host1@host1-virtual-machine:~/usr/hadoop-3.2.1$ sbin/start-all.sh
WARNING: Attempting to start all Apache Hadoop daemons as host1 in 10 seconds.
WARNING: This is not a recommended production deployment configuration.
WARNING: Use CTRL-C to abort.
Starting namenodes on [localhost]
localhost: host1@localhost: Permission denied (publickey,password).
Starting datanodes
localhost: host1@localhost: Permission denied (publickey,password).
Starting secondary namenodes [host1-virtual-machine]
host1-virtual-machine: host1@host1-virtual-machine: Permission denied (publickey,password).
Starting resourcemanager
Starting nodemanagers
localhost: host1@localhost: Permission denied (publickey,password).

【问题讨论】:

    标签: hadoop hdfs bigdata hadoop-yarn


    【解决方案1】:

    您需要在节点之间建立无密码连接。此链接可能会有所帮助 http://mynotesonhadoop.blogspot.com/2017/07/configuring-passwordless-ssh-from.html?m=1

    【讨论】:

    • 谢谢!!在你的两个回答之后,我解决了两个问题,不同的用户和无密码连接。
    • 如果解决了查询,你可以接受我的解决方案
    猜你喜欢
    • 2016-02-15
    • 2021-07-12
    • 2021-01-28
    • 1970-01-01
    • 1970-01-01
    • 2021-12-05
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多