hadoop - Oozie不清除Oozie数据库中的旧作业

Question

我在 oozie-site.xml 中设置了以下属性(在Cloudera Manager中使用安全阀)

oozie.services.ext - org.apache.oozie.service.PurgeService
oozie.service.PurgeService.older.than - 15
oozie.service.PurgeService.coord.older.than - 7
oozie.service.PurgeService.bundle.older.than - 7
oozie.service.PurgeService.purge.interval - 60

但是，我仍然看到一些旧的工作，这些工作已经杀死或完成至2014年9月

举个例子

我有一个协调器，该协调器当前处于“运行中”状态。当我使用Oozie Web Console列出该协调器的实例时，即单击“协调器”选项卡并单击我的协调器，然后在弹出窗口中，我看到所有具体工作流作业中最旧的作业(协调器操作)的日期(2014年9月)。

我假设负责清理的属性为 oozie.service.PurgeService.older.than ，我将其设置为 15 天。

那我在这里想念什么？

Answer 1

问题是高频的协调器作业长时间运行。由于协调作业仍在运行，因此不会清除所有子工作流程。

解决方案是(从外部链接引用)，

What you can do as a workaround, is split up your long-running Coordinators. For example, instead of making your Coordinator run for years? forever?, make it run for, say, 6 months. And have an identical Coordinator scheduled to start exactly when that one ends. This will allow Oozie to cleanup the old child Workflows from that Coordinator every 6 months. Otherwise, you can schedule a cron job to manually delete old jobs from the Database. However, please be careful about this. When deleting a workflow job from the WF_JOBS table, you'll also need to delete the workflow actions from the WF_ACTIONS table that belong to it, as well as the coordinator action from the WF_ACTIONS table that it belongs to. If you miss something, it will likely cause problems.

引用:

https://community.cloudera.com/t5/Batch-Processing-and-Workflow/Oozie-not-cleaning-up-old-jobs-from-Oozie-database/m-p/30692#U30692

https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/zkWa2kDMyyo

http://qnalist.com/questions/5404909/oozie-purging

JIRA链接:

https://issues.apache.org/jira/browse/OOZIE-1532