hadoop - Sqoop-使用Oozie导入Hive失败

Question

我试图执行从Oracle到Hive的sqoop导入，但是作业失败并出现错误
WARN [main] conf.HiveConf (HiveConf.java:initialize(2472)) - HiveConf of name hive.auto.convert.sortmerge.join.noconditionaltask does not exist
Intercepting System.exit(1)
<<< Invocation of Main class completed <<<
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
Oozie Launcher failed, finishing Hadoop job gracefully

我将所有jar文件都放在适当的位置

hive metastore配置中也有

hive-site.xml
<property>
<name>hive.metastore.uris</name>
<value>thrift://sv2lxgsed01.xxxx.com:9083</value>
</property>

我能够成功运行sqoop导入(使用oozie)到HDFS。

我也能够成功执行配置单元脚本(使用oozie)

我也可以从命令行执行sqoop-hive导入，但是相同
使用oozie

执行命令时命令失败

我的workflow.xml如下
<workflow-app name="WorkflowWithSqoopAction" xmlns="uri:oozie:workflow:0.1">
<start to="sqoopAction"/>
<action name="sqoopAction">
<sqoop xmlns="uri:oozie:sqoop-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<command>import --connect
jdbc:oracle:thin:@//sv2axcrmdbdi301.xxx.com:1521/DI3CRM --username xxxxxxx --password xxxxxx--table SIEBEL.S_ORG_EXT --hive-table eg.EQX_EG_CRM_S_ORG_EXT --hive-import -m1</command>
<file>/user/oozie/oozieProject/workflowSqoopAction/hive-site.xml</file>
</sqoop>
<ok to="end"/>
<error to="killJob"/>
</action>
<kill name="killJob">
<message>"Killed job due to error: ${wf:errorMessage(wf:lastErrorNode())}"</message>
</kill>
<end name="end" />
</workflow-app>
我还可以找到正在HDFS中加载的数据。

Answer 1

你需要做两件事

1)将hive-site.xml复制到oozie工作流目录中2)在您的Hive Action 中，告诉oozie使用我的hive-site.xml