hadoop - 错误 org.apache.pig.tools.grunt.Grunt - 错误 2998 : Unhandled internal error. org/apache/hadoop/hbase/filter/WritableByteArrayComparable

Question

通过搜索，我发现了这个问题，并且按照说明遇到了同样的问题。

CDH4 Hbase using Pig ERROR 2998 java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/filter/Filter

但对我没有用。此外，我正在使用 Ubuntu 和 Hadoop-2.2.0、Hbase-0.96.1-hadoop2 和 Pig-0.12.0。

文件

export JAVA_HOME=/usr
export HADOOP_INSTALL=/home/ubuntu/hadoop-2.2.0
export PATH=$PATH:$HADOOP_INSTALL/bin
export PATH=$PATH:$HADOOP_INSTALL/sbin
export HADOOP_MAPRED_HOME=$HADOOP_INSTALL
export HADOOP_COMMON_HOME=$HADOOP_INSTALL
export HADOOP_HDFS_HOME=$HADOOP_INSTALL
export YARN_HOME=$HADOOP_INSTALL

export HADOOP_COMMON_LIB_NATIVE_DIR=${HADOOP_COMMON_HOME}/lib/native
export HADOOP_OPTS="-Djava.library.path=${HADOOP_COMMON_HOME}/lib"
export PIG_HOME=/home/ubuntu/pig-0.12.0
export HBASE_HOME=/home/ubuntu/hbase-0.96.1-hadoop2
export PIG_CLASSPATH="'${HADOOP_INSTALL}/bin/hbase classpath':$PIG_HOME/bin"

日志 pig

Pig Stack Trace
---------------
ERROR 2998: Unhandled internal error.     
org/apache/hadoop/hbase/filter/WritableByteArrayComparable

java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/filter/WritableByteArrayComparable

Pig.properties

fs.defaultFS=hdfs://hadoop-master/
mapred.job.tracker=hadoop-master:8021

Answer 1

我猜对了

export PIG_CLASSPATH=$PIG_HOME/pig-0.12.0-withouthadoop.jar:$HBASE_HOME/hbase-0.94.1.jar:$HBASE_HOME/lib/*:$HADOOP_COMMON_LIB_NATIVE_DIR/lib/*:$PIG_CLASSPATH