【发布时间】:2014-01-13 19:23:41
【问题描述】:
我正在运行一个 hadoop 作业,它卡在“map 0% reduce 0%”。更具体地说,映射器都处于“STARTING”状态,似乎从未真正开始执行。
我已经尝试查看日志,但除了一些弃用消息之外并没有真正看到任何内容。我不确定要寻找什么,想知道是否有人有任何建议?
编辑 1:
stderr 日志:
26, 2013 1:15:32 AM com.google.inject.servlet.InternalServletModule$BackwardsCompatibleServletContextProvider get
WARNING: You are attempting to use a deprecated API (specifically, attempting to @Inject ServletContext inside an eagerly created singleton. While we allow this for backwards compatibility, be warned that this MAY have unexpected behavior if you have more than one injector (with ServletModule) running in the same JVM. Please consult the Guice documentation at http://code.google.com/p/google-guice/wiki/Servlets for more information.
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class
Dec 26, 2013 1:15:33 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest
【问题讨论】:
-
你能把日志贴在这里吗?
-
我不想让线程混乱,所以我想知道哪些日志最相关? DataNode、NameNode、SecondaryNameNode、ResourceManager 或 NodeManager 日志中的任何一个有用吗?在 userlogs 下,容器也有 syslog、stderr 和 stdout 日志。 stdout 是空的,但 stderr 不是。我现在会发布 stderr,如果还有其他您认为值得一看的内容,我会进行编辑。