t收集器未收集数据tsdb为空

bq3bfh9z  于 2021-06-09  发布在  Hbase
关注(0)|答案(3)|浏览(443)

我成功地安装和运行了它

http://54.72.4.157:4242/

我正在我们的一台服务器上运行tcollector,并将主机设置为startstop.sh

TSD_HOST=54.72.4.157

是的

./startstop start

运行所有统计数据收集器。甚至注意到在tsdb控制台日志中

[id: 0x5fc4bb31, /54.184.79.13:60203 => /172.31.14.125:4242] CONNECTED: /54.184.79.13:60203

在我的tcollector节点上,

ps axl | grep tcollector

我能看见

0     0 16796 16795  20   0 183712  8000 poll_s Sl   ?          2:17 /usr/bin/python /home/mithralaya/tcollector/tcollector.py -c /home/mithralaya/tcollector/collectors -H 54.72.4.157 -t host=ip-172-31-12-203 -P /var/run/tcollector.pid
4 65534 16806 16796  20   0  39864  3748 poll_s Ss   ?          0:08 /usr/bin/python /home/mithralaya/tcollector/collectors/0/procstats.py
4 65534 16808 16796  39  19  39700  3380 poll_s SNs  ?          0:07 /usr/bin/python /home/mithralaya/tcollector/collectors/0/procnettcp.py
4 65534 16816 16796  20   0  39648  3240 poll_s Ss   ?          0:00 /usr/bin/python /home/mithralaya/tcollector/collectors/0/iostat.py
4 65534 16818 16796  20   0  39648  3400 poll_s Ss   ?          0:01 /usr/bin/python /home/mithralaya/tcollector/collectors/0/ifstat.py
4 65534 16822 16796  20   0  41848  3676 poll_s Ss   ?          0:05 /usr/bin/python /home/mithralaya/tcollector/collectors/0/netstat.py
4 65534 16824 16796  20   0  39648  3524 poll_s Ss   ?          0:00 /usr/bin/python /home/mithralaya/tcollector/collectors/0/dfstat.py
0     0 26617 26171  20   0   8108   940 pipe_w S+   pts/0      0:00 grep --color=auto tcollector

我在tcollector log on/var/log/tcollector中看不到任何重大错误。最新日志

2014-04-15 08:59:40,630 tcollector[16796] WARNING: haproxy.py: Error: HAProxy is not running
2014-04-15 08:59:55,090 tcollector[16796] INFO: removing redis-stats.py from the list of collectors (by request)
2014-04-15 08:59:55,091 tcollector[16796] INFO: removing nfsstat.py from the list of collectors (by request)
2014-04-15 08:59:55,091 tcollector[16796] WARNING: collector hbase_master.py terminated after 16 seconds with status code 1, marking dead
2014-04-15 08:59:55,091 tcollector[16796] INFO: removing udp_bridge.py from the list of collectors (by request)
2014-04-15 08:59:55,091 tcollector[16796] INFO: removing elasticsearch.py from the list of collectors (by request)
2014-04-15 08:59:55,092 tcollector[16796] INFO: removing zfsiostats.py from the list of collectors (by request)
2014-04-15 08:59:55,092 tcollector[16796] INFO: removing varnishstat.py from the list of collectors (by request)
2014-04-15 08:59:55,092 tcollector[16796] INFO: removing mongo.py from the list of collectors (by request)
2014-04-15 08:59:55,093 tcollector[16796] INFO: removing couchbase.py from the list of collectors (by request)
2014-04-15 08:59:55,093 tcollector[16796] INFO: removing graphite_bridge.py from the list of collectors (by request)
2014-04-15 08:59:55,093 tcollector[16796] INFO: removing zfskernstats.py from the list of collectors (by request)
2014-04-15 08:59:55,094 tcollector[16796] INFO: removing smart-stats.py from the list of collectors (by request)
2014-04-15 08:59:55,094 tcollector[16796] WARNING: collector mysql.py terminated after 16 seconds with status code 1, marking dead
2014-04-15 08:59:55,094 tcollector[16796] WARNING: collector hbase_regionserver.py terminated after 16 seconds with status code 1, marking dead
2014-04-15 08:59:55,095 tcollector[16796] INFO: removing postgresql.py from the list of collectors (by request)
2014-04-15 08:59:55,095 tcollector[16796] INFO: removing haproxy.py from the list of collectors (by request)
2014-04-15 08:59:55,095 tcollector[16796] INFO: removing riak.py from the list of collectors (by request)
2014-04-15 08:59:55,095 tcollector[16796] INFO: removing zookeeper.py from the list of collectors (by request)
2014-04-15 08:59:55,096 tcollector[16796] INFO: removing opentsdb.sh from the list of collectors (by request)
2014-04-15 09:09:40,651 tcollector[16796] INFO: Heartbeat (6 collectors running)
2014-04-15 09:19:41,217 tcollector[16796] INFO: Heartbeat (6 collectors running)
2014-04-15 09:29:41,794 tcollector[16796] INFO: Heartbeat (6 collectors running)
2014-04-15 09:39:43,586 tcollector[16796] INFO: Heartbeat (6 collectors running)

但是没有一个数据被收集。在hbase中,tsdb和tsdb uid都是空的。

hbase(main):002:0> scan 'tsdb'
ROW                                                          COLUMN+CELL                                                                                                                                                                      
0 row(s) in 0.2890 seconds

hbase(main):003:0>

你也可以在这里看到,

http://54.72.4.157:60010/

如果有人能帮我这个忙,我将不胜感激。
所有基于hadoop的技术都很难安装和配置。我花了一个星期的时间才弄明白这一点,我运行了24小时的tcollector,但tsdb中仍然没有数据。
非常感谢,
卡尔蒂克

ibrsph3r

ibrsph3r1#

从日志文件输出来看,似乎没有一个tcollector插件在实际运行。他们得到繁殖和删除后,由于错误的权利。

whitzsjs

whitzsjs2#

请尝试将conf文件设置为自动创建度量


# --------- CORE ----------

# Whether or not to automatically create UIDs for new metric types, default

# is False

tsd.core.auto_create_metrics = true
myss37ts

myss37ts3#

好吧,可能有几个收集器像procstats.py那样运行(它收集cpu、内存等基本指标),我注意到错误日志中没有。
您没有将数据获取到hbase,可能是因为opentsdb config设置为需要手动创建度量的默认值。如果是这样,那么你必须自己定义度量标准。
相反,要创建自动创建的度量,请尝试转到opentsdb服务器,检查配置并将度量创建设置为自动。
具体来说,在/etc/opentsdb/opentsdb.conf中,将参数“tsd.core.auto\u create\u metrics”设置为true,然后重新启动opentsdb服务。
然后再次检查hbase,看看是否可以在“tsdb uid”中看到数据。

相关问题