java - 容器启动 exitCode=1 hadoop 出现异常

Question

我在没有cygwin的情况下在windows中安装了hadoop 2.8.1。我可以通过start-all.cmd启动hadoop。但是当我运行 wordcount.jar 时，出现以下错误

命令:hadoop jar WordCount.jar WordCount G:/Hadoop/input 输出

Application application_1511001920752_0003 failed 2 times due to AM Container for appattempt_1511001920752_0003_000002 exited with exitCode: 1
Failing this attempt.Diagnostics: Exception from container-launch.
Container id: container_1511001920752_0003_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:972)
at org.apache.hadoop.util.Shell.run(Shell.java:869)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1170)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:236)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:305)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:84)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Shell output: 1 file(s) moved.
Container exited with a non-zero exit code 1
For more detailed output, check the application tracking page: http://DESKTOP-ETS7CRG:8088/cluster/app/application_1511001920752_0003 Then click on links to logs of each attempt.
. Failing the application.

用户日志中的stderr文件仅包含1行:系统找不到指定的路径。我不明白它找不到哪个文件。

Answer 1

您正在提供一个本地文件作为输入文件。 Wordcount 程序需要 HDFS 文件/目录作为输入，因此失败。

请将文件放入HDFS并重试。它应该可以工作。