Job Counters
Launched map tasks=3
Launched reduce tasks=45
Data-local map tasks=1
Rack-local map tasks=2
Total time spent by all maps in occupied slots (ms)=29338
Total time spent by all reduces in occupied slots (ms)=200225
Total time spent by all map tasks (ms)=29338
Total time spent by all reduce tasks (ms)=200225
Total vcore-seconds taken by all map tasks=29338
Total vcore-seconds taken by all reduce tasks=200225
Total megabyte-seconds taken by all map tasks=30042112
Total megabyte-seconds taken by all reduce tasks=205030400
“vcore秒”是什么意思,“vcore秒”和“花费的总时间”有什么区别
1条答案
按热度按时间pokxtpni1#
关于这个指标没有正式的文档,但是如果我理解的很好的话(请看这里),vcore seconds是hadoop为某个任务分配vcore的秒数之和。
我认为这个指标显示了mapreduce应用程序在map和reduce阶段花费了多少时间,而不涉及其他任务(计划任务、无序排列和排序中间键等)