在hdfs接收器连接器的新版本中,偏移存储已更改。在旧版本中,我可以使用kafka工具来监视连接器延迟,以进行消费者监视(比如“kafka消费者组”)。
但现在,我在我们的日志中看到这样一个信息:
log.info("HDFS connector does not commit consumer offsets to Kafka. Upon startup, HDFS "
+ "Connector restores offsets from filenames in HDFS. In the absence of files in HDFS, "
+ "the connector will attempt to find offsets for its consumer group in the "
+ "'__consumer_offsets' topic. If offsets are not found, the consumer will "
+ "rely on the reset policy specified in the 'consumer.auto.offset.reset' property to "
+ "start exporting data to HDFS.");
所以我的问题是,我们如何监控这个连接器?
暂无答案!
目前还没有任何答案,快来回答吧!