监视hdfs接收器连接器延迟

h7wcgrx3  于 2021-06-06  发布在  Kafka
关注(0)|答案(0)|浏览(200)

在hdfs接收器连接器的新版本中,偏移存储已更改。在旧版本中,我可以使用kafka工具来监视连接器延迟,以进行消费者监视(比如“kafka消费者组”)。
但现在,我在我们的日志中看到这样一个信息:

log.info("HDFS connector does not commit consumer offsets to Kafka. Upon startup, HDFS "
        + "Connector restores offsets from filenames in HDFS. In the absence of files in HDFS, "
        + "the connector will attempt to find offsets for its consumer group in the "
        + "'__consumer_offsets' topic. If offsets are not found, the consumer will "
        + "rely on the reset policy specified in the 'consumer.auto.offset.reset' property to "
        + "start exporting data to HDFS.");

所以我的问题是,我们如何监控这个连接器?

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题