有没有一种方法可以激活giraph中的giraph属性?

nwlls2ji  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(407)

似乎giraph sta只使用map reduce(giraph-1.3.0-snapshot使用-phadoop2 mvn profile构建)写入日志。
有没有办法在日志中使用yarn也激活giraph stats(giraph-1.3.0-snapshot内置-phadoop\u yarn mvn profile)?
下面是giraph stats的示例。

2018-09-08 16:03:01,604 INFO org.apache.hadoop.mapreduce.Job: Counters:   42
File System Counters
    FILE: Number of bytes read=74623213
    FILE: Number of bytes written=75518013
    FILE: Number of read operations=0
    FILE: Number of large read operations=0
    FILE: Number of write operations=0
Map-Reduce Framework
    Map input records=1
    Map output records=0
    Input split bytes=44
    Spilled Records=0
    Failed Shuffles=0
    Merged Map outputs=0
    GC time elapsed (ms)=100
    CPU time spent (ms)=0
    Physical memory (bytes) snapshot=0
    Virtual memory (bytes) snapshot=0
    Total committed heap usage (bytes)=3087007744
Giraph Stats
    Aggregate bytes loaded from local disks (out-of-core)=0
    Aggregate bytes stored to local disks (out-of-core)=0
    Aggregate edges=12
    Aggregate finished vertices=0
    Aggregate sent message bytes=3154
    Aggregate sent messages=24
    Aggregate vertices=5
    Current master task partition=0
    Current workers=1
    Last checkpointed superstep=0
    Lowest percentage of graph in memory so far (out-of-core)=100
    Sent message bytes=1701
    Sent messages=12
    Superstep=2
Giraph Timers
    Initialize (ms)=653
    Input superstep (ms)=599
    Setup (ms)=58
    Shutdown (ms)=8967
    Superstep 0 Worker_Superstep0 (ms)=295
    Superstep 1 Worker_Superstep1 (ms)=605
    Total (ms)=10538
Zookeeper base path
    /_hadoopBsp/job_local881103217_0001=0
Zookeeper halt node
    /_hadoopBsp/job_local881103217_0001/_haltComputation=0
Zookeeper server:port
    cri:22181=0
File Input Format Counters
    Bytes Read=0
File Output Format Counters
    Bytes Written=0
uttx8gqw

uttx8gqw1#

使用

-ca giraph.metrics.enable=true

如中所述http://giraph.apache.org/options.html

相关问题