我正在尝试配置flink历史服务器。我在这里跟踪了Flink的文件。我可以打开历史服务器,但只能看到已完成的作业,而不能看到正在运行的作业。是我遗漏了什么,还是只是完成的作业显示在历史服务器中。请帮忙。
当前在群集中的作业:
localhost:8081/joboverview
{
"running": [
{
"jid": "e4e6edb76b887054d7aca460b7136937",
"name": "Filter",
"state": "RUNNING",
"start-time": 1505971363801,
"end-time": -1,
"duration": 11588615,
"last-modification": 1505971363832,
"tasks": {
"total": 1,
"pending": 0,
"running": 1,
"finished": 0,
"canceling": 0,
"canceled": 0,
"failed": 0
}
}
],
"finished": [
{
"jid": "ec16f4cf01192268150c750966cefd0d",
"name": "Flink Java Job at Thu Sep 21 10:52:09 IST 2017",
"state": "FINISHED",
"start-time": 1505971329989,
"end-time": 1505971330746,
"duration": 757,
"last-modification": 1505971330746,
"tasks": {
"total": 3,
"pending": 0,
"running": 0,
"finished": 3,
"canceling": 0,
"canceled": 0,
"failed": 0
}
}
]
}
历史服务器中可用的作业
localhost:8082/joboverview
{
"running": [],
"finished": [
{
"jid": "ec16f4cf01192268150c750966cefd0d",
"name": "Flink Java Job at Thu Sep 21 10:52:09 IST 2017",
"state": "FINISHED",
"start-time": 1505971329989,
"end-time": 1505971330746,
"duration": 757,
"last-modification": 1505971330746,
"tasks": {
"total": 3,
"pending": 0,
"running": 0,
"finished": 3,
"canceling": 0,
"canceled": 0,
"failed": 0
}
}
]
}
flink历史服务器配置:
# ==============================================================================
# HistoryServer
# ==============================================================================
# The HistoryServer is started and stopped via bin/historyserver.sh (start|stop)
# Directory to upload completed jobs to. Add this directory to the list of
# monitored directories of the HistoryServer as well (see below).
jobmanager.archive.fs.dir: hdfs://<hdfs>:8020/sax/flink/jobmanager
# The address under which the web-based HistoryServer listens.
historyserver.web.address: localhost
# The port under which the web-based HistoryServer listens.
historyserver.web.port: 8082
# Comma separated list of directories to monitor for completed jobs.
historyserver.archive.fs.dir: hdfs://<hdfs>:8020/sax/flink/jobmanager
# Interval in milliseconds for refreshing the monitored directories.
historyserver.archive.fs.refresh-interval: 10000
1条答案
按热度按时间ddrv8njm1#
你链接的flink网站的第一行写道:
flink有一个历史服务器,可以用来在相应的flink集群关闭后查询已完成作业的统计信息。
这也说明
historyserver允许您查询jobmanager存档的已完成作业的状态和统计信息。
据我所知,您还可以使用localhost:8081/joboverview,如果只想访问正在运行的作业,则可以使用“/joboverview/running”uri访问它们
您可以在这里的监视api链接中找到更多信息。