kafka.consumer.rangeassignor:消费线程logstash\u logstash-indexer不使用代理分区

alen0pnh  于 2021-06-08  发布在  Kafka
关注(0)|答案(1)|浏览(269)

我有一个麋鹿设置,其中一个logstash是推数据到Kafka和另一个logstash是从Kafka拉数据。
下面是我的kafka输入配置,用于从中提取数据的logstashkafka:-

input {
    kafka {
        zk_connect => "kafka:2181"
        group_id => "logstash"
        topic_id => "logstash_logs"
        reset_beginning => false
        consumer_threads => 3
    }
}

我已经讨论了这个github问题&&我的logstash主题有3个分区。
启动logstash后,我看到以下警告,logstash没有从中提取任何数据kafka:-

'[DEPRECATED] use `require 'concurrent'` instead of `require 'concurrent_ruby'`
log4j, [2015-10-27T00:11:50.471]  WARN: kafka.consumer.RangeAssignor: No broker partitions consumed by consumer thread logstash_logstash-indexer-1445884909915-d6a99924-2 for topic logstash_logs
log4j, [2015-10-27T00:11:50.471]  WARN: kafka.consumer.RangeAssignor: No broker partitions consumed by consumer thread logstash_logstash-indexer-1445884909915-d6a99924-0 for topic logstash_logs
log4j, [2015-10-27T00:11:50.471]  WARN: kafka.consumer.RangeAssignor: No broker partitions consumed by consumer thread logstash_logstash-indexer-1445884909915-d6a99924-1 for topic logstash_logs
Logstash startup completed

环境-
日志存储-1.5.3
Kafka-0.8.2.1
有人能告诉我还能出什么问题吗?

vdzxcuhz

vdzxcuhz1#

这已经在elasticsearch讨论组中得到了回答。

相关问题