hadoop map进程报错: percent descend to 0 , map completes becomed negative number

Question

奇怪的是我的工作看起来像这样:

map 的百分比下降到0。

13/02/15 06:04:44 INFO mapred.JobClient:  map 20% reduce 20%
13/02/15 06:14:33 INFO mapred.JobClient:  map 19% reduce 20%
13/02/15 06:22:30 INFO mapred.JobClient:  map 18% reduce 20%
13/02/15 06:30:41 INFO mapred.JobClient:  map 17% reduce 20%
13/02/15 06:40:39 INFO mapred.JobClient:  map 16% reduce 20%
13/02/15 06:49:30 INFO mapred.JobClient:  map 15% reduce 20%
13/02/15 06:57:41 INFO mapred.JobClient:  map 14% reduce 20%
13/02/15 07:06:49 INFO mapred.JobClient:  map 13% reduce 20%
13/02/15 07:16:22 INFO mapred.JobClient:  map 12% reduce 20%
13/02/15 07:24:19 INFO mapred.JobClient:  map 11% reduce 20%
13/02/15 07:33:22 INFO mapred.JobClient:  map 10% reduce 20%
13/02/15 07:42:14 INFO mapred.JobClient:  map 9% reduce 20%
13/02/15 07:50:47 INFO mapred.JobClient:  map 8% reduce 20%
13/02/15 07:59:12 INFO mapred.JobClient:  map 7% reduce 20%
13/02/15 08:08:04 INFO mapred.JobClient:  map 6% reduce 20%
13/02/15 08:16:44 INFO mapred.JobClient:  map 5% reduce 20%
13/02/15 08:25:26 INFO mapred.JobClient:  map 4% reduce 20%
13/02/15 08:34:16 INFO mapred.JobClient:  map 3% reduce 20%
13/02/15 08:42:21 INFO mapred.JobClient:  map 2% reduce 20%
13/02/15 08:51:55 INFO mapred.JobClient:  map 1% reduce 20%
13/02/15 08:59:56 INFO mapred.JobClient:  map 0% reduce 20%

完成的 map 是-4169

Jobid   Priority    User    Name    Map % Complete  Map Total   **Maps Completed**  Reduce % Complete   Reduce Total    Reduces Completed   Job Scheduling Information  Diagnostic Info
job_201302111406_2339   NORMAL  hadoop  MonitorUVFreqStatMRPrepare  0.00%
34140   **-4169**   20.92%
60   0  NA  NA

有人知道会发生什么吗？

Answer 1

通常，百分比下降表示 map/reduce 任务在执行一段时间后失败(因此具有正百分比)。在您的情况下，也许所有映射器都未能将百分比设置为零。