gpt4 book ai didi

hadoop - Oozie Hive Action处于“准备”状态,作业处于“运行”状态

转载 作者:行者123 更新时间:2023-12-02 21:43:36 28 4
gpt4 key购买 nike

我的Oozie Hive Action 永远处于运行模式。 oozie.log文件中没有显示错误。

<workflow-app xmlns="uri:oozie:workflow:0.2.5" name="example-wf">
<credentials>
<credential name='hive_credentials' type='hive'>
<property>
<name>hive.metastore.uris</name>
<value>thrift://localhost:9083</value>
</property>
</credential>
</credentials>
<start to="hive-example"/>
<action name="hive-example" cred="hive_credentials">
<hive xmlns="uri:oozie:hive-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<job-xml>hive-site.xml</job-xml>
<configuration>
<property>
<name>oozie.log.hive.level</name>
<value>DEBUG</value>
</property>
<property>
<name>oozie.hive.defaults</name>
<value>hive-default.xml</value>
</property>
</configuration>
<script>script.q</script>
<file>hive-site.xml</file>
</hive>
<ok to="end"/>
<error to="fail"/>
</action>
<kill name="fail">
<message>Workflow failed, error message[${wf:errorMessage(wf:lastErrorNode())}]
</message>
</kill>
<end name="end"/>
</workflow-app>

另外我的job.properties如下所示
nameNode=hdfs://hadoopmaster:54310
jobTracker=localhost:54311
workflowRoot=${nameNode}/user/${user.name}/oozie-workflows
oozie.wf.application.path=hdfs://hadoopmaster:54310/home/hadoopuser/Downloads/oozie
workflows

另外我的工作日志如下

2014-11-13 18:19:57,697信息ActionStartXCommand:539-USER [hadoopuser] GROUP [-] token [] APP [example-wf] JOB [0000001-141113180803793-oozie-hado-W] ACTION [0000001-141113180803793- oozie-hado-W @:start:]以用户重试状态开始操作[0000001-141113180803793-oozie-hado-W @:start:]:userRetryCount [0],userRetryMax [0],userRetryInterval [10]
2014-11-13 18:19:57,698警告ActionStartXCommand:542-USER [hadoopuser] GROUP [-] token [] APP [example-wf] JOB [0000001-141113180803793-oozie-hado-W] ACTION [0000001-141113180803793- oozie-hado-W @:start:] [ 0000001-141113180803793-oozie-hado-W @:start:] Action 状态= DONE
2014-11-13 18:19:57,698警告ActionStartXCommand:542-USER [hadoopuser] GROUP [-] token [] APP [example-wf] JOB [0000001-141113180803793-oozie-hado-W] ACTION [0000001-141113180803793- oozie-hado-W @:start:] [ 0000001-141113180803793-oozie-hado-W @:start:] DB中的操作已更新!
2014-11-13 18:19:57,801信息ActionStartXCommand:539-USER [hadoopuser] GROUP [-] token [] APP [example-wf] JOB [0000001-141113180803793-oozie-hado-W] ACTION [0000001-141113180803793- oozie-hado-W @ hive-example]以用户重试状态开始操作[0000001-141113180803793-oozie-hado-W @ hive-example]:userRetryCount [0],userRetryMax [0],userRetryInterval [10]

我已经将hive-site.xml放在oozie的工作流目录中,并将工作流目录(包含workflow.xml,hive-site.xml,hive-default.xml)上传到HDFS。作业日志中没有错误。所以我不确定我在哪里犯错。任何帮助是极大的赞赏。

最佳答案

群集设置中有多少个容器?
当您执行工作流程时,一个容器将被oozie占用(它将继续保留该容器直到查询执行),其余的将被用于执行实际的作业。

关于hadoop - Oozie Hive Action处于“准备”状态,作业处于“运行”状态,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/26935597/

28 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com