gpt4 book ai didi

bin/hadoop tasktracker 命令中的 Hadoop/cygwin 失败

转载 作者:可可西里 更新时间:2023-11-01 14:54:40 26 4
gpt4 key购买 nike

我正在关注 http://ebiquity.umbc.edu/Tutorials/Hadoop/00%20-%20Intro.html

通过执行在第一个窗口中启动namenodecd hadoop-0.19.1bin/hadoop 名称节点通过执行在第二个窗口中启动辅助名称节点cd hadoop-0.19.1bin/hadoop secondarynamenode通过执行启 Action 业跟踪器的第三个窗口cd hadoop-0.19.1bin/hadoop jobtracker通过执行启动数据节点第四个窗口cd hadoop-0.19.1bin/hadoop 数据节点通过执行启动任务跟踪器的第五个窗口cd hadoop-0.19.1bin/hadoop 任务跟踪器

直到“bin/hadoop datanode”工作正常,最后一个“bin/hadoop tasktracker”

这是我得到的

`$ bin/hadoop tasktracker
bin/hadoop: line 350: C:\Program: command not found
13/05/22 09:42:15 INFO mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG: host = xxxx/10.10.200.94
STARTUP_MSG: args = []
STARTUP_MSG: version = 1.2.0
STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r 1479473; compiled by 'hortonfo' on Mon May 6 06:59:37 UTC 2013
STARTUP_MSG: java = 1.7.0_21
************************************************************/
13/05/22 09:42:15 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
13/05/22 09:42:15 INFO impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered.
13/05/22 09:42:15 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
13/05/22 09:42:15 INFO impl.MetricsSystemImpl: TaskTracker metrics system started
13/05/22 09:42:15 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/05/22 09:42:15 INFO impl.MetricsSourceAdapter: MBean for source ugi registered.
13/05/22 09:42:15 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
13/05/22 09:42:15 INFO http.HttpServer: Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
Patch for HADOOP-7682: Instantiating workaround file system
13/05/22 09:42:15 INFO mapred.TaskLogsTruncater: Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
13/05/22 09:42:15 INFO mapred.TaskTracker: Starting tasktracker with owner as xxxx
13/05/22 09:42:15 INFO mapred.TaskTracker: Good mapred local directories are: /tmp/hadoop-xxxx/mapred/local
Patch for HADOOP-7682: Ignoring IOException setting persmission for path "/tmp/hadoop-xxx/mapred/local/taskTracker": Failed to set permissions of path: \tmp\hadoop-xxxx\mapred\local\taskTracker to 0755
Patch for HADOOP-7682: Ignoring IOException setting persmission for path "/tmp/hadoop-xxxx/mapred/local/ttprivate": Failed to set permissions of path: \tmp\hadoop-xxxx\mapred\local\ttprivate to 0700
Patch for HADOOP-7682: Ignoring IOException setting persmission for path "/tmp/hadoop-xxx/mapred/local/tt_log_tmp": Failed to set permissions of path: \tmp\hadoop-xxxx\mapred\local\tt_log_tmp to 0755
13/05/22 09:42:15 INFO impl.MetricsSourceAdapter: MBean for source jvm registered.
13/05/22 09:42:15 INFO impl.MetricsSourceAdapter: MBean for source TaskTrackerMetrics registered.
13/05/22 09:42:15 INFO ipc.Server: Starting SocketReader
13/05/22 09:42:15 INFO impl.MetricsSourceAdapter: MBean for source RpcDetailedActivityForPort53336 registered.
13/05/22 09:42:15 INFO impl.MetricsSourceAdapter: MBean for source RpcActivityForPort53336 registered.
13/05/22 09:42:15 INFO ipc.Server: IPC Server Responder: starting
13/05/22 09:42:15 INFO ipc.Server: IPC Server listener on 53336: starting
13/05/22 09:42:15 INFO ipc.Server: IPC Server handler 0 on 53336: starting
13/05/22 09:42:15 INFO ipc.Server: IPC Server handler 1 on 53336: starting
13/05/22 09:42:15 INFO ipc.Server: IPC Server handler 2 on 53336: starting
13/05/22 09:42:15 INFO ipc.Server: IPC Server handler 3 on 53336: starting
13/05/22 09:42:15 INFO mapred.TaskTracker: TaskTracker up at: 127.0.0.1/127.0.0.1:53336
13/05/22 09:42:15 INFO mapred.TaskTracker: Starting tracker tracker_xxxx.local:127.0.0.1/127.0.0.1:53336
13/05/22 09:42:16 INFO mapred.TaskTracker: Starting thread: Map-events fetcher for all reduce tasks on tracker_xxx.local:127.0.0.1/127.0.0.1:53336
13/05/22 09:42:16 INFO mapred.TaskTracker: Using ResourceCalculatorPlugin : null
13/05/22 09:42:16 WARN util.ProcessTree: setsid is not available on this machine. So not using it.
13/05/22 09:42:16 INFO util.ProcessTree: setsid exited with exit code 0
13/05/22 09:42:16 INFO util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux.
13/05/22 09:42:16 INFO mapred.TaskTracker: ProcessTree implementation is missing on this system. TaskMemoryManager is disabled.
13/05/22 09:42:16 INFO mapred.IndexCache: IndexCache created with max memory = 10485760
13/05/22 09:42:16 INFO impl.MetricsSourceAdapter: MBean for source ShuffleServerMetrics registered.
13/05/22 09:42:16 INFO http.HttpServer: Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 50060
13/05/22 09:42:16 INFO http.HttpServer: listener.getLocalPort() returned 50060 webServer.getConnectors()[0].getLocalPort() returned 50060
13/05/22 09:42:16 INFO http.HttpServer: Jetty bound to port 50060
13/05/22 09:42:16 INFO mortbay.log: jetty-6.1.26
13/05/22 09:42:16 INFO mortbay.log: Started SelectChannelConnector@0.0.0.0:50060
13/05/22 09:42:16 INFO mapred.TaskTracker: FILE_CACHE_SIZE for mapOutputServlet set to : 2000
13/05/22 09:42:16 INFO mapred.TaskTracker: Failed to get system directory...
13/05/22 09:42:21 INFO mapred.TaskTracker: Failed to get system directory...
13/05/22 09:42:24 INFO mapred.TaskTracker: Failed to get system directory...
13/05/22 09:42:26 INFO mapred.TaskTracker: Failed to get system directory...
13/05/22 09:42:30 INFO mapred.TaskTracker: Failed to get system directory...
13/05/22 09:42:32 INFO mapred.TaskTracker: Failed to get system directory...
13/05/22 09:42:33 INFO mapred.TaskTracker: Failed to get system directory...
13/05/22 09:42:35 INFO mapred.TaskTracker: Failed to get system directory...
13/05/22 09:42:36 INFO mapred.TaskTracker: Failed to get system directory...
13/05/22 09:42:40 INFO mapred.TaskTracker: Failed to get system directory...

`

有人可以帮忙吗......

最佳答案

问题是 Java JDK 的文件路径“Program Files”中空间的使用。 Here是解决问题的方法

关于bin/hadoop tasktracker 命令中的 Hadoop/cygwin 失败,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/16694495/

26 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com