org.apache.hadoop.security.AccessControlException: 权限被拒绝: user=test-user, access=EXECUTE, inode="system":hadoop:test-user:rwx------

Question

以前的 test-user 曾经驻留在失去连接的边缘服务器上。因此，我们重建了边缘服务器并一直在尝试启动并运行它，但我不断收到以下错误。

Job initialization failed: 
org.apache.hadoop.security.AccessControlException:
org.apache.hadoop.security.AccessControlException: Permission denied:
user=test-user, access=EXECUTE,
inode="system":hadoop:test-user:rwx------ at
sun.reflect.GeneratedConstructorAccessor20.newInstance(Unknown Source)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at
org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
at
org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:57)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.<init>(DFSClient.java:3371)
at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:743) at
org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:182)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:557) at
org.apache.hadoop.fs.FileSystem.create(FileSystem.java:538) at
org.apache.hadoop.fs.FileSystem.create(FileSystem.java:445) at
org.apache.hadoop.fs.FileSystem.create(FileSystem.java:437) at
org.apache.hadoop.security.Credentials.writeTokenStorageFile(Credentials.java:169)
at
org.apache.hadoop.mapred.JobInProgress.generateAndStoreTokens(JobInProgress.java:3802)
at
org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:970)
at org.apache.hadoop.mapred.JobTracker.initJob(JobTracker.java:4237)
at
org.apache.hadoop.mapred.FairScheduler$JobInitializer$InitJob.run(FairScheduler.java:301)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724) Caused by:
org.apache.hadoop.ipc.RemoteException:
org.apache.hadoop.security.AccessControlException: Permission denied:
user=report_generator, access=EXECUTE,
inode="system":hadoop:report_generator:rwx------ at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:199)
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:155)

Answer 1

hadoop:test-user:rwx------ 权限意味着只有 hadoop 用户可以访问这些文件。消息中的test-user 是一个组，而不是一个用户。并且没有组可以访问指定的路径

如果test-user不在自己的组中，则需要chown路径，否则，可以chmod 770。

另一个帐户最后出现类似错误

hadoop:report_generator:rwx------

并且这些用户和组需要首先存在于namenode上，其次是edge节点