hadoop作业日志中的“vcore秒”是什么意思?

yrwegjxp  于 2021-06-02  发布在  Hadoop
关注(0)|答案(1)|浏览(672)
Job Counters
    Launched map tasks=3
    Launched reduce tasks=45
    Data-local map tasks=1
    Rack-local map tasks=2
    Total time spent by all maps in occupied slots (ms)=29338
    Total time spent by all reduces in occupied slots (ms)=200225
    Total time spent by all map tasks (ms)=29338
    Total time spent by all reduce tasks (ms)=200225
    Total vcore-seconds taken by all map tasks=29338
    Total vcore-seconds taken by all reduce tasks=200225
    Total megabyte-seconds taken by all map tasks=30042112
    Total megabyte-seconds taken by all reduce tasks=205030400

“vcore秒”是什么意思,“vcore秒”和“花费的总时间”有什么区别

pokxtpni

pokxtpni1#

关于这个指标没有正式的文档,但是如果我理解的很好的话(请看这里),vcore seconds是hadoop为某个任务分配vcore的秒数之和。
我认为这个指标显示了mapreduce应用程序在map和reduce阶段花费了多少时间,而不涉及其他任务(计划任务、无序排列和排序中间键等)

相关问题