gpt4 book ai didi

ubuntu - JPS 给出空输出,没有一个 Hadoop 守护进程以 start-all.sh 开头,Hadoop Psudo 分布式模式,在 64 位 Windows 操作系统上运行的 32 位虚拟机上

转载 作者:可可西里 更新时间:2023-11-01 16:46:16 25 4
gpt4 key购买 nike

我正在尝试在运行于 64 位操作系统之上的 32 位虚拟机上设置 Hadoop2.7.1、Java OpenJDK 7。我已经配置了这里提到的所有文件 http://pingax.com/install-hadoop2-6-0-on-ubuntu/

即使在我运行 start-dfs.sh 或 start-all.sh 之后,也没有任何守护进程启动。

这是 start,jps 命令的输出

hduser@ubuntu:~$ start-dfs.sh
16/04/22 00:33:14 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [localhost]
localhost: starting namenode, logging to /usr/local/hadoop/logs/hadoop-hduser-namenode-ubuntu.out
localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-hduser-datanode-ubuntu.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-ubuntu.out
16/04/22 00:33:33 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
hduser@ubuntu:~$ jps
12147 Jps
hduser@ubuntu:~$

我似乎无法理解原因。就警告而言,正如其他一些答案中指出的那样,可以忽略或禁止警告。

我进一步看到提到的调试文件的内容是这样的

hduser@ubuntu:~$ cat /usr/local/hadoop/logs/hadoop-hduser-namenode-ubuntu.out
OpenJDK Client VM warning: You have loaded library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
(kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 14869
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
hduser@ubuntu:~$

数据节点的日志文件中甚至给出了相同的错误。任何帮助将不胜感激...


编辑:

https://chawlasumit.wordpress.com/2014/06/17/hadoop-java-hotspottm-execstack-warning/

按照建议我进行了更改,但这只是抑制了日志中的错误,

hduser@ubuntu:~$ cat /usr/local/hadoop/logs/hadoop-hduser-namenode-ubuntu.out
ulimit -a for user hduser
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 14869
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 14869
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited

最佳答案

检查您的配置文件。确保您的 .xml 文件(尤其是您的 core-site.xml)的内容与 here 相同.很少有网站有过时的教程,他们在 core-site.xml 文件中提到“fs.default.name”而不是“fs.defaultFS”。

关于ubuntu - JPS 给出空输出,没有一个 Hadoop 守护进程以 start-all.sh 开头,Hadoop Psudo 分布式模式,在 64 位 Windows 操作系统上运行的 32 位虚拟机上,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/36787804/

25 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com