gpt4 book ai didi

hadoop - Hadoop作业停留在 map 上0%减少0%

转载 作者:行者123 更新时间:2023-12-02 21:51:09 25 4
gpt4 key购买 nike

我正在运行hadoop作业,卡在“ map 0%减少0%”。更具体地说,映射器都处于“STARTING”状态,并且似乎从未真正开始执行。

我尝试查看日志,但除了一些弃用消息外,没有看到其他东西。我不确定要寻找什么,并且想知道是否有人提出建议?

编辑1:

stderr日志:

 26, 2013 1:15:32 AM com.google.inject.servlet.InternalServletModule$BackwardsCompatibleServletContextProvider get
WARNING: You are attempting to use a deprecated API (specifically, attempting to @Inject ServletContext inside an eagerly created singleton. While we allow this for backwards compatibility, be warned that this MAY have unexpected behavior if you have more than one injector (with ServletModule) running in the same JVM. Please consult the Guice documentation at http://code.google.com/p/google-guice/wiki/Servlets for more information.
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class
Dec 26, 2013 1:15:33 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Dec 26, 2013 1:15:33 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest

最佳答案

通常查看ResourceManager的日志可能会有所帮助。在其日志中查找任何异常。如果不存在异常,请查看NodeManager日志中是否有任何异常。在这里告知这些可能的异常(exception)。

关于hadoop - Hadoop作业停留在 map 上0%减少0%,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/20779728/

25 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com