confluent连接器在一段时间后停止工作,没有任何错误

8gsdolmq  于 2021-06-04  发布在  Kafka
关注(0)|答案(0)|浏览(275)

我有问题与Kafka合流连接器,连接器停止工作后的一段时间,当我看了连接器的日志文件没有错误。
这是日志文件的最后一行。

[2020-10-27 01:18:28,370] DEBUG Closing TopicPartitionWriter cctvViolations-0 (io.confluent.connect.hdfs3.TopicPartitionWriter:431)
[2020-10-27 01:18:28,370] DEBUG Closing TopicPartitionWriter cctvViolations-2 (io.confluent.connect.hdfs3.TopicPartitionWriter:431)
[2020-10-27 01:18:28,370] DEBUG WorkerSinkTask{id=hdfs-sink -0} Skipping offset commit, no change since last commit (org.apache.kafka.connect.runtime.Worker$
[2020-10-27 01:18:28,370] DEBUG WorkerSinkTask{id=hdfs-sink -0} Finished offset commit successfully in 0 ms for sequence number 831: null (org.apache.kafka.$
[2020-10-27 01:18:28,371] DEBUG WorkerSinkTask{id=hdfs-sink -0} Partitions revoked (org.apache.kafka.connect.runtime.WorkerSinkTask:692)
[2020-10-27 01:18:28,371] DEBUG Writer looking for last offsets for topic partitions [] (io.confluent.connect.hdfs3.DataWriter:499)
[2020-10-27 01:18:28,371] DEBUG Returning committed offsets {} (io.confluent.connect.hdfs3.Hdfs3SinkTask:130)
[2020-10-27 01:18:28,371] DEBUG WorkerSinkTask{id=hdfs-sink -0} Skipping offset commit, task opted-out by returning no offsets from preCommit (org.apache.ka$
[2020-10-27 01:18:28,371] DEBUG WorkerSinkTask{id=hdfs-sink -0} Finished offset commit successfully in 0 ms for sequence number 832: null (org.apache.kafka.$
[2020-10-27 01:18:28,376] DEBUG Graceful stop of task hdfs-sink -0 succeeded. (org.apache.kafka.connect.runtime.Worker:870)
[2020-10-27 01:18:28,386] DEBUG ShutdownHookManger completed shutdown. (org.apache.hadoop.util.ShutdownHookManager:154)
[2020-10-27 01:18:28,390] INFO Stopping connector hdfs-sink  (org.apache.kafka.connect.runtime.Worker:387)
[2020-10-27 01:18:28,390] INFO Scheduled shutdown for WorkerConnector{id=hdfs-sink } (org.apache.kafka.connect.runtime.WorkerConnector:249)
[2020-10-27 01:18:28,390] INFO Completed shutdown for WorkerConnector{id=hdfs-sink } (org.apache.kafka.connect.runtime.WorkerConnector:269)
[2020-10-27 01:18:28,390] DEBUG Graceful stop of connector hdfs-sink  succeeded. (org.apache.kafka.connect.runtime.Worker:427)
[2020-10-27 01:18:28,391] INFO Worker stopping (org.apache.kafka.connect.runtime.Worker:209)
[2020-10-27 01:18:28,391] INFO Stopped FileOffsetBackingStore (org.apache.kafka.connect.storage.FileOffsetBackingStore:66)
[2020-10-27 01:18:28,391] DEBUG Unregistering Connect metrics with JMX for worker '127.0.0.1:8083' (org.apache.kafka.connect.runtime.ConnectMetrics:169)
[2020-10-27 01:18:28,391] INFO Worker stopped (org.apache.kafka.connect.runtime.Worker:230)
[2020-10-27 01:18:28,392] INFO Herder stopped (org.apache.kafka.connect.runtime.standalone.StandaloneHerder:120)
[2020-10-27 01:18:28,392] INFO Kafka Connect stopped (org.apache.kafka.connect.runtime.Connect:72)

我在独立模式下运行连接器
下面是我用来启动连接器的命令

bin/connect-standalone.sh config/connect-standalone.properties config/hdfs.properties > /dev/null 2>&1 &

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题