gpt4 book ai didi

Hadoop 作业和任务跟踪器不工作

转载 作者:可可西里 更新时间:2023-11-01 16:32:42 26 4
gpt4 key购买 nike

当我启动 hadoop job tracker 和 task tracker 时不工作。

我正在使用两台计算机。 master-furkanb@master 192.168.2.135 和 slave-detay@slave192.168.2.250。

xml 和 hosts 文件在 2 台计算机上相同。

我已经写到控制台jps了。

JPS

15568 日元12126 二级名称节点11812 名称节点11934 数据节点12314 资源管理器

我的主机文件

/etc/主机

127.0.0.1 localhost

127.0.1.1 ubuntu.ubuntu-domain ubuntu

192.168.2.135 master

192.168.2.250 slave

核心站点.xml

<configuration>

<property>
<name>fs.default.name</name>
<value>hdfs://master:54310</value>
</property>

</configuration>

hdfs-site.xml

<configuration>
<property>
<name>dfs.replication</name>
<value>2</value>
</property>
</configuration>

mapred-site.xml

<configuration>

<property>
<name>mapred.job.tracker</name>
<value>master:54311</value>
</property>

<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>

</configuration>

yarn-site.xml

<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce.shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>

主机:

/etc/hadoop/masters furkanb@master

/etc/hadoop/slaves furkanb@master detay@slave

从机:

/etc/hadoop/slaves localhost

当我在控制台上写 start-all.sh 时:

This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
14/04/09 14:52:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [master]
master: starting namenode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-namenode-master.out
furkanb@master: starting datanode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-datanode-master.out
detay@slave: starting datanode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-detay-datanode-slave.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-secondarynamenode-master.out
14/04/09 14:53:19 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-furkanb-resourcemanager-master.out
furkanb@master: starting nodemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-furkanb-nodemanager-master.out
detay@slave: starting nodemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-detay-nodemanager-slave.out

我可以到达 localhost:50070 和 master:50070。但我无法到达 localhost:50030 或 master:50030

最佳答案

您使用的是 Yarn 而不是经典的 mapreduce。您在这里找不到 Jobtracker。要检查正在运行的应用程序的状态,您需要使用资源管理器的 http 端口。即 8088

查看以下网址本地主机:8088

关于Hadoop 作业和任务跟踪器不工作,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/22962027/

26 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com