我想使用ganglia监视hadoop（hadoop版本0.20.2）多节点集群。我的hadoop工作正常。我已经安装了ganglia后，阅读了以下博客---
http://hakunamapdata.com/ganglia-configuration-for-a-small-hadoop-cluster-and-some-troubleshooting/
http://hokamblogs.blogspot.in/2013/06/ganglia-overview-and-installation-on.html
我还研究了ganglia.pdf（附录b ganglia和hadoop/hbase）的监控。
I have modified only the following lines in**Hadoop-metrics.properties**(same on all Hadoop Nodes)==>
// Configuration of the "dfs" context for ganglia
dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
dfs.period=10
dfs.servers=192.168.1.182:8649
// Configuration of the "mapred" context for ganglia
mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext
mapred.period=10
mapred.servers=192.168.1.182:8649:8649
// Configuration of the "jvm" context for ganglia
jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext
jvm.period=10
jvm.servers=192.168.1.182:8649
**gmetad.conf**(Only on Hadoop master Node )
data_source "Hadoop-slaves" 5 192.168.1.182:8649
RRAs "RRA:AVERAGE:0.5:1:302400" //Because i want to analyse one week data.
**gmond.conf**(on all the Hadoop Slave nodes and Hadoop Master)
globals {
daemonize = yes
setuid = yes
user = ganglia
debug_level = 0
max_udp_msg_len = 1472
mute = no
deaf = no
allow_extra_data = yes
host_dmax = 0 /*secs */
cleanup_threshold = 300 /*secs */
gexec = no
send_metadata_interval = 0
}
cluster {
name = "Hadoop-slaves"
owner = "Sandeep Priyank"
latlong = "unspecified"
url = "unspecified"
}
/* The host section describes attributes of the host, like the location */
host {
location = "CASL"
}
/* Feel free to specify as many udp_send_channels as you like. Gmond
used to only support having a single channel */
udp_send_channel {
host = 192.168.1.182
port = 8649
ttl = 1
}
/* You can specify as many udp_recv_channels as you like as well. */
udp_recv_channel {
port = 8649
}
/* You can specify as many tcp_accept_channels as you like to share
an xml description of the state of the cluster */
tcp_accept_channel {
port = 8649
}现在ganglia只提供所有节点的系统度量（mem、disk等）。但是它没有在web界面上显示hadoop度量（比如jvm、mapred度量等）。我怎样才能解决这个问题？
2条答案
按热度按时间ktca8awb1#
我确实在ganglia上使用hadoop，是的，我在ganglia上看到了很多hadoop的度量（容器、Map任务、vmem）。事实上，hadoop特定于ganglio的报告有上百个度量。
这篇文章已经足够了。
我在主节点上编辑hadoop-metrics2.properties，内容是：
我也在从机上编辑同样的文件：
请记住，在更改文件后重新启动hadoop和ganglia。
我希望这对你有帮助。
nfg76nw02#
感谢所有人，如果您使用的是旧版本的hadoop，那么将以下文件（来自新版本的hadoop）==>
gangliacontext31.java文件
gangliacontext.java文件
在path==>hadoop/src/core/org/apache/hadoop/metrics/ganglia的新版本中。
使用ant编译hadoop（并在编译时设置适当的代理）。如果它给出了函数定义丢失之类的错误，那么将该函数定义（来自新版本）放入适当的java文件中，然后再次编译hadoop。会有用的。