你能告诉我apachekafka和zookeeper(本地apachedistributuins)与一些confluent组件的兼容性吗。我已经在我的环境中安装了kafka和zookeeper作为多节点集群。但现在我需要添加模式注册表,kafka connect。
所以我实际上试着从他们的docker官方图片中部署合流模式注册表。我登录并成功地在端口9093上telnet kafka broker
root@schema-0:/usr/bin# telnet kafka-0.kafka-hs 9093
Trying 10.244.3.47...
Connected to kafka-0.kafka-hs.log-platform.svc.cluster.local.
Escape character is '^]'.
在我试着做了一些测试之后:
# /usr/bin/kafka-avro-console-producer \
--broker-list localhost:9093 --topic bar \
--property value.schema='{"type":"record","name":"myrecord","fields" \
[{"name":"f1","type":"string"}]}'
添加一些值:
{"f1": "value1"}
但运气不好:(。出现下一个错误:
value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer
(org.apache.kafka.clients.producer.ProducerConfig)
[2018-01-28 11:23:23,561] INFO Kafka version : 1.0.0-cp1 (org.apache.kafka.common.utils.AppInfoParser)
[2018-01-28 11:23:23,561] INFO Kafka commitId : ec61c5e93da662df (org.apache.kafka.common.utils.AppInfoParser){"f1": "value1"}
[2018-01-28 11:23:36,233] WARN [Producer clientId=console-producer] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2018-01-28 11:23:36,335] WARN [Producer clientId=console-producer] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2018-01-28 11:23:36,486] WARN [Producer clientId=console-producer] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
整个系统都在kubernetes上旋转
1条答案
按热度按时间bqucvtff1#
confluent平台是ApacheKafka,但附带了附加组件(如SchemaRegistry)。
您遇到的错误与网络配置有关。您需要确保您的代理对其他节点可用,包括schema registry。在您指定的模式注册表配置中
broker-list localhost:9093
但这应该是你的Kafka经纪人。此外,正如dmitryminkovsky提到的,确保您已经在代理中设置了广告侦听器。这篇文章可能会有所帮助。