hadoop - Datanode和Namenode运行但未反射(reflect)在UI中

Question

在Hadoop中配置主服务器和从属服务器时，我遇到了一些挫折，在主服务器和从属服务器中，我的namenode和datanode都已启动并正在运行。

但是，WebUI中的LiveNodes计数未得到反射(reflect)，但节点正在运行。

我已经尝试禁用防火墙并格式化节点，但是无法解决相同的问题。

任何帮助将不胜感激!

以下是片段:

主:

jps命令输出:

5088 Jps

4446 NameNode

4681 SecondaryNameNode

奴隶 :

jps命令输出:

2478秒

2410数据节点

ubuntu@hadoop-master:/usr/local/hadoop/etc/hadoop$ $HADOOP_HOME/bin/hdfs dfsadmin -refreshNodes
16/04/28 02:22:37 WARN ipc.Client: Address change detected. Old: hadoop-master/52.200.230.29:50077 New: hadoop-master/127.0.0.1:50077
refreshNodes: Call From hadoop-master/127.0.0.1 to hadoop-master:50077 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

hadoop-slave-1的日志文件:

2016-04-28 21:23:07,248 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000
2016-04-28 21:23:12,257 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000
2016-04-28 21:23:17,265 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000
2016-04-28 21:23:22,273 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000
2016-04-28 21:23:27,282 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000
2016-04-28 21:23:32,291 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000

Hadoop-master的日志文件:

2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll Edit Log from 127.0.0.1
2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Rolling edit logs
2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Ending log segment 407
2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of syncs: 2 SyncTimes(ms): 22
2016-04-28 21:21:04,003 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of syncs: 3 SyncTimes(ms): 23
2016-04-28 21:21:04,003 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Finalizing edits file /usr/local/hadoop/hadoop_data/hdfs/namenode/current/edits_inprogress_0000000000000000407 -> /usr/local/hadoop/hadoop_data/hdfs/namenode/current/edits_0000000000000000407-0000000000000000408
2016-04-28 21:21:04,004 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 409

我的主服务器上的netstat -pant命令:

ubuntu@hadoop-master:/usr/local/hadoop/etc/hadoop$ netstat -pant
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
tcp        0      0 0.0.0.0:50070           0.0.0.0:*               LISTEN      21491/java
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -
tcp        0      0 0.0.0.0:50077           0.0.0.0:*               LISTEN      -
tcp        0      0 127.0.0.1:50078         0.0.0.0:*               LISTEN      21491/java
tcp        0      0 0.0.0.0:9000            0.0.0.0:*               LISTEN      -
tcp        0      0 0.0.0.0:50090           0.0.0.0:*               LISTEN      21726/java
tcp        0      0 172.31.63.189:50070     128.235.8.68:57225      ESTABLISHED 21491/java
tcp        0      0 127.0.0.1:41471         127.0.0.1:50078         TIME_WAIT   -
tcp        0    124 172.31.63.189:22        128.235.8.68:56950      ESTABLISHED -
tcp        0      0 172.31.63.189:50070     128.235.8.68:57224      ESTABLISHED 21491/java
tcp        0      0 172.31.63.189:50070     128.235.8.68:57223      ESTABLISHED 21491/java
tcp        0      0 172.31.63.189:22        128.235.8.68:57084      ESTABLISHED -
tcp        0      0 172.31.63.189:22        58.218.204.215:39402    ESTABLISHED -
tcp        0      0 172.31.63.189:50070     128.235.8.68:57227      ESTABLISHED 21491/java
tcp        0      0 172.31.63.189:50070     128.235.8.68:57228      ESTABLISHED 21491/java
tcp        0      0 172.31.63.189:50070     128.235.8.68:57226      ESTABLISHED 21491/java
tcp6       0      0 :::22                   :::*                    LISTEN      -
tcp6       0      0 :::50077                :::*                    LISTEN      -
tcp6       0      0 :::9000                 :::*                    LISTEN      -

Answer 1

连接被拒绝
我可以从您的帖子中看到此错误。我想你需要做三件事

确保50077端口被某个进程侦听，并且它是您的hadoop进程

确保使用诸如telnet

之类的工具可以访问

除了防火墙。 selinux也会影响访问。因此，请关闭它并重新启动服务，然后重试