gpt4 book ai didi

java - Mac OS X上的Hadoop 'HadoopIllegalArgumentException: An XAttr name must be prefixed'错误

转载 作者:行者123 更新时间:2023-12-02 21:41:46 25 4
gpt4 key购买 nike

今天,我尝试按照Setting up Hadoop 2.4 and Pig 0.12 on OSX locally上的说明在Mac OS X Lion上安装Hadoop。
我已经正确设置了

JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.7.0_71.jdk/Contents/Home set both ~/.bash_profile and .bashrc


并使用brew成功安装了最新版本的Hadoop(2.6.0),并编辑了这4个配置文件: hdfs.site.xml,core-site.xml,mapred-site.xml,yarn-site.xml
但是运行:

./bin/hdfs namenode -format


给出:
15/01/29 17:42:01 INFO namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = Venuses-Mac-mini.local/192.168.1.51
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 2.6.0
STARTUP_MSG: classpath = /usr/local/Cellar/hadoop/2.6.0/libexec /etc/hadoop:/usr/local/Cellar/hadoop/2.6.0/libexec/share/hadoop/common /lib/activation-1.1.jar <TRUNCATED - Big Chunk of Code Containing .jar Filenames>
STARTUP_MSG: build = https://git-wip-us.apache.org/repos /asf/hadoop.git -r e3496499ecb8d220fba99dc5ed4c99c8f9e33bb1; compiled by 'jenkins' on 2014-11-13T21:10Z
STARTUP_MSG: java = 1.6.0_29
<TRUNCATED - Big Chunk of .jar Filnames TRUNCATED>
************************************************************/
15/01/29 17:42:01 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
15/01/29 17:42:01 INFO namenode.NameNode: createNameNode [-format]
2015-01-29 17:42:02.551 java[1016:1903] Unable to load realm info from SCDynamicStore
15/01/29 17:42:02 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: CID-aaa7a5a6-3e82-4166-8039-16046f1b4761
<TRUNCATED>
15/01/29 17:42:03 ERROR namenode.FSNamesystem: FSNamesystem initialization failed.
org.apache.hadoop.HadoopIllegalArgumentException: An XAttr name must be prefixed with user/trusted/security/system/raw, followed by a '.'
at org.apache.hadoop.hdfs.XAttrHelper.buildXAttr(XAttrHelper.java:72)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.<init>(FSDirectory.java:137)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:894)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:755)
at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:934)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1379)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
15/01/29 17:42:03 INFO namenode.FSNamesystem: Stopping services started for active state
15/01/29 17:42:03 INFO namenode.FSNamesystem: Stopping services started for standby state
15/01/29 17:42:03 FATAL namenode.NameNode: Failed to start namenode.
<TRUNCATED>
15/01/29 17:42:03 INFO util.ExitUtil: Exiting with status 1
15/01/29 17:42:03 INFO namenode.NameNode: SHUTDOWN_MSG:
我的Mac上安装了2个版本的Java Hadoop使用较旧的版本1.6.0_29,而不是当前版本1.7.0_72。我不知道让Hadoop考虑当前的Java版本很热门。
注意:我在Google上进行了广泛的搜索,找不到针对此特定错误的解决方案。
谢谢。

最佳答案

在Terminal Shell中运行以下命令会得到什么?
/usr/libexec/java_home
如果返回1.6 JDK,则可能是hadoop正在使用该命令来确定要使用哪个Java。例如,可能正在发生的一个地方是文件“/usr/local/Cellar/hadoop/2.6.0/libexec/etc/hadoop/hadoop-env.sh”。第25行是:
export JAVA_HOME="$(/usr/libexec/java_home)"
尝试将其更改为:
export JAVA_HOME="$(/usr/libexec/java_home -v1.7)"
为了将JAVA_HOME设置为1.7 JDK。也可能是其他的hadoop文件正在做类似的事情来查找Java。

关于java - Mac OS X上的Hadoop 'HadoopIllegalArgumentException: An XAttr name must be prefixed'错误,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/28219112/

25 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com