1 topic, 1 partition - then Kafka connect will only spawn a single task
2 topics, 1 partition each - then Kafka connect will spawn 2 tasks, 1 for each topic
2 topics, 5 partitions each - then Kafka connection will spawn 10 tasks, 1 for each topic partition
4 topics, 5 partitions each - the Kafka connection will spawn 10 tasks, each handling data from 2 topic partitions.
1条答案
按热度按时间knsnq2tg1#
确切的算法是kafka connect内部的,但它通常与分区和主题的数量有关。因此,例如,如果将tasks.max设置为10,并具有以下接收器连接器配置:
在另一个论坛上得到了这个解释。