hadoop - hadoop作业日志中的 "vcore-seconds"是什么意思？

Question

Job Counters
    Launched map tasks=3
    Launched reduce tasks=45
    Data-local map tasks=1
    Rack-local map tasks=2
    Total time spent by all maps in occupied slots (ms)=29338
    Total time spent by all reduces in occupied slots (ms)=200225
    Total time spent by all map tasks (ms)=29338
    Total time spent by all reduce tasks (ms)=200225
    Total vcore-seconds taken by all map tasks=29338
    Total vcore-seconds taken by all reduce tasks=200225
    Total megabyte-seconds taken by all map tasks=30042112
    Total megabyte-seconds taken by all reduce tasks=205030400

“vcore-seconds”是什么意思，“vcore-seconds”和“总花费时间”有什么区别

Answer 1

没有关于此指标的官方文档，但如果我理解得很好(see here)，vcore-seconds 是 Hadoop 为某些任务分配 vcore 的秒数总和。

我认为这个指标显示了您的 MapReduce 应用程序在 Map 和 Reduce 阶段花费了多少时间，而不涉及其他任务(计划任务、洗牌和排序中间键等...)