hadoop - Oozie war creation - 不支持的 Hadoop 版本支持版本 : 0. 20.1、0.20.2、0.20.104、0.20.200、0.23.x 和 2.x

Question

我正在尝试在 hadoop 1.0.3 上安装 oozie 3.3.2，我无法创建 oozie.war。我正在按照中的说明进行操作 http://venkatrequiescence.blogspot.in/2012/12/oozie-installation.html.When我执行以下命令我得到 - 不受支持的 Hadoop 版本支持的版本:0.20.1、0.20.2、0.20.104、0.20.200、0.23.x 和 2.x

./$OOZIE_HOME/distro/target/oozie-3.3.2/oozie/bin/oozie-setup.sh -hadoop 1.0.3/-extjs/Users/hadoop/ext-2.2.zip.

我什至尝试通过查看以下链接中给出的解决方案来解决此问题，但我无法解决该问题，因为解决方案中给出的文章不是很清楚，请帮助我

How to install Oozie 3.3.1 on Hadoop 1.1.1? .

Answer 1

嗯，我不知道这是否会 work在运行时，但您可以通过 -jar 手动列出 hadoop jar选项而不是通过 -hadoop :

./oozie-setup.sh -jars /opt/hadoop/hadoop-1.0.3/hadoop-core-1.0.3.jar:/opt/hadoop/hadoop-1.0.3/lib/jackson-core-asl-1.8.8.jar:/opt/hadoop/hadoop-1.0.3/lib/jackson-mapper-asl-1.8.8.jar:/opt/hadoop/hadoop-1.0.3/lib/commons-configuration-1.6.jar

如果您查看 addtowar.sh脚本(这是此错误消息的来源)，您可以看到一组条件 jar，以根据通过 -hadoop 指定的 hadoop 版本包含在内。选项:

#get the list of hadoop jars that will be injected based on the hadoop version
function getHadoopJars() {
  version=$1
  if [ "${version}" = "0.20.1" ]; then
    #List is separated by ":"
    hadoopJars="hadoop-core*.jar"
  elif [ "${version}" = "0.20.2" ]; then
    #List is separated by ":"
    hadoopJars="hadoop-core*.jar"
  elif [ "${version}" = "0.20.104" ]; then
    #List is separated by ":"
    hadoopJars="hadoop-core*.jar:jackson-core-asl-*.jar:jackson-mapper-asl-*.jar"
  elif [ "${version}" = "0.20.200" ]; then
    #List is separated by ":"
    hadoopJars="hadoop-core*.jar:jackson-core-asl-*.jar:jackson-mapper-asl-*.jar:commons-configuration-*.jar"
  elif [[ "${version}" =~ .*23 ]]; then
    suffix="-[0-9.]*"
    #List is separated by ":"
    hadoopJars="hadoop-mapreduce-client-core${suffix}.jar:hadoop-mapreduce-client-common${suffix}.jar:hadoop-mapreduce-client-jobclient${suffix}.jar:hadoop-mapreduce-client-app${suffix}.jar:hadoop-yarn-common${suffix}.jar:hadoop-yarn-api${suffix}.jar:hadoop-hdfs${suffix}.jar:hadoop-common${suffix}.jar:hadoop-auth${suffix}.jar:guava*.jar:protobuf-*.jar:avro-ipc-*.jar:jackson-core-asl-*.jar:jackson-mapper-asl-*.jar:commons-configuration-*.jar"
  elif [[ "${version}" =~ 2.* ]]; then
    suffix="-[0-9.]*"
    #List is separated by ":"
    hadoopJars="hadoop-mapreduce-client-core${suffix}.jar:hadoop-mapreduce-client-common${suffix}.jar:hadoop-mapreduce-client-jobclient${suffix}.jar:hadoop-mapreduce-client-app${suffix}.jar:hadoop-yarn-common${suffix}.jar:hadoop-yarn-api${suffix}.jar:hadoop-yarn-client${suffix}.jar:hadoop-hdfs${suffix}.jar:hadoop-common${suffix}.jar:hadoop-auth${suffix}.jar:guava*.jar:protobuf-*.jar:jackson-core-asl-*.jar:jackson-mapper-asl-*.jar:commons-configuration-*.jar:commons-cli-*.jar"
  else
    echo
    echo "Exiting: Unsupported Hadoop version '${hadoopVer}', supported versions: 0.20.1, 0.20.2, 0.20.104, 0.20.200, 0.23.x and 2.x"
    echo
    cleanUp
    exit -1;
  fi
}

所以看到 1.0.x 不在列表中，您可以查看 0.20.104 或 0.20.200 版本并使用与 1.0.3 相同的 jar :

• hadoop-core-1.0.3
• lib/jackson-core-asl-1.8.8.jar
• lib/jackson-mapper-asl-1.8.8.jar
• lib/commons-configuration-1.6.jar

我不明白为什么它不起作用(oozie 只需要与 mapred 和 hdfs 服务通信)，但你可能在运行时遇到问题 - 值得一试(我已经用 3.1.3-incubating 试过了并且我所做的少量测试没有任何问题)