gpt4 book ai didi

hadoop - 无法访问 yarn UI。在8088端口上访问YARN UI表示未找到服务器

转载 作者:行者123 更新时间:2023-12-02 20:32:15 24 4
gpt4 key购买 nike

这是我的yarn-site.xml文件:

<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>

<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>

<property>
<name>yarn.resourcemanager.resource-tracker.address</name>
<value>master:8031</value>
</property>

<property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>master:8030</value>
</property>
<property>

<name>yarn.resourcemanager.address</name>
<value>master:8032</value>
</property>

<property>
<name>yarn.log-aggregation-enable</name>
<value>true</value>
</property>

<property>
<name>yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds</name>
<value>3600</value>
</property>


<property>
<name>yarn.nodemanager.vmem-pmem-ratio</name>
<value>16</value>
</property>

<property>
<name>yarn.nodemanager.pmem-check-enabled</name>
<value>true</value>
</property>

<property>
<name>yarn.nodemanager.vmem-check-enabled</name>
<value>false</value>
</property>

<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>24576</value>
</property>

<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>2048</value>
</property>

</configuration>

当我尝试使用URL http://secondary:8088/proxy/application_xxxxxxxxxxxxx_xxxx/访问YARN UI来监视我的作业时,将 secondary替换为运行namenode的主机的IP地址,我在Firefox中收到 Server Not Found错误。我缺少从xml文件中通过UI查看作业的哪些配置?我正在使用hadoop 2.5.2,它是具有5个从属和1个主控的6节点群集。

这是我的/ etc / hosts文件:
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
10.0.70.149 secondary
10.0.70.148 master
10.0.70.143 slave1
10.0.70.144 slave2
10.0.70.145 slave3
10.0.70.146 slave4
10.0.70.147 slave5

最佳答案

如果您在日志中没有错误,我使用了0.0.0.0作为yarn-site.xml中的yarn.resourcemanager.hostname解决了问题
查看所有同伴
https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-common/yarn-default.xml

关于hadoop - 无法访问 yarn UI。在8088端口上访问YARN UI表示未找到服务器,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/52848676/

24 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com