gpt4 book ai didi

hadoop - 错误2998:未处理的内部错误。运行代码

转载 作者:行者123 更新时间:2023-12-02 21:43:48 24 4
gpt4 key购买 nike

执行以下命令-x local -f /Hbase/load_hbase.pig
我收到以下错误

2014-11-08 23:36:47,455 [main] INFO  org.apache.pig.Main - Apache Pig version 0.12.1 (r1585011) compiled Apr 05 2014, 01:41:34
2014-11-08 23:36:47,455 [main] INFO org.apache.pig.Main - Logging error messages to: /home/eduardo/pig_1415497007452.log
2014-11-08 23:36:47,817 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /home/eduardo/.pigbootup not found
2014-11-08 23:36:47,918 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:///
2014-11-08 23:36:48,436 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. org/apache/hadoop/hbase/filter/WritableByteArrayComparable

这是我运行的代码:
raw_data = LOAD '/data/QCLCD201211/201201hourly.txt' USING PigStorage(',');
weather_data = FOREACH raw_data GENERATE $1, $10;
ranked_data = RANK weather_data;
final_data = FILTER ranked_data BY $0 IS NOT NULL;
STORE final_data INTO 'hbase://weather'
USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:date info:temp');

我想知道我做错了什么,我会记下hadoop,hbase和pig的版本。
Hadoop:hadoop-1.2.1
Hbase:hbase-0.96.2-hadoop1
pig : pig 0.12.1

最佳答案

在hadoop中复制 pig jar 和hbase jar

1)将这些文件复制到HADOOP库。

sudo cp /usr/lib/pig/lib/pig-common-0.8.0-cdh3u0.jar  /usr/lib/hadoop/lib/
sudo cp /usr/lib/pig/lib/hbase-0.96.2-cdh3u0.jar /usr/lib/hadoop/lib/
sudo cp /usr/lib/pig/lib/hbase-0.96.2-cdh3u0.jar /usr/lib/hadoop/lib/

2)使用以下逗号关闭HBASE和HADOOP
/usr/lib/hadoop/bin/stop-all.sh
/usr/lib/hbase/bin/stop-hbase.sh

3)使用COMMOND重新启动HBASE和HADOOP
 /usr/lib/hadoop/bin/start-all.sh
/usr/lib/hadoop/bin/start-hbase.sh

关于hadoop - 错误2998:未处理的内部错误。运行代码,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/26824026/

24 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com