从javaapi连接kafka aws示例

pw9qyyiw  于 2021-06-04  发布在  Kafka
关注(0)|答案(1)|浏览(362)

我试图通过本地spring引导api连接kafka aws示例。
我可以连接它,但在听主题时,它抛出了一个下面的异常,但新的主题是由springbootapi成功创建的,我也无法发布任何消息。

java.io.IOException: Can't resolve address: ip-xxx-xx-xx-xx.ec2.internal:9092
at org.apache.kafka.common.network.Selector.doConnect(Selector.java:235) ~[kafka-clients-2.0.1.jar:na]

Caused by: java.nio.channels.UnresolvedAddressException: null
    at sun.nio.ch.Net.checkAddress(Net.java:101) ~[na:1.8.0_192]
    at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:622) ~[na:1.8.0_192]
    at org.apache.kafka.common.network.Selector.doConnect(Selector.java:233) ~[kafka-clients-2.0.1.jar:na]
    ... 30 common frames omitted

2019-07-17 15:36:13.581  WARN 3709 --- [           main] org.apache.kafka.clients.NetworkClient   : [Consumer clientId=consumer-1, groupId=group_id] Error connecting to node ip-172-31-80-50.ec2.internal:9092 (id: 0 rack: null)

我允许这个端口以及自定义tcp规则tcp 2181 0.0.0.0/0自定义tcp规则tcp 9092 0.0.0.0/0

server:
  port: 8081
spring:
  kafka:
    consumer:
      bootstrap-servers: xx.xx.xx.xx:9092
      group-id: group_id
      auto-offset-reset: earliest
      key-deserializer: org.apache.kafka.common.serialization.StringDeserializer
      value-deserializer: org.apache.kafka.common.serialization.StringDeserializer
    producer:
      bootstrap-servers: xx.xx.xx.xx:9092
      key-serializer: org.apache.kafka.common.serialization.StringSerializer
      value-serializer: org.apache.kafka.common.serialization.StringSerializer

@KafkaListener(topics = "ConsumerTest", groupId = "group_id")
    public void consume(String message) throws IOException {
        logger.info(String.format("#### -> Consumed message -> %s", message));
    }
shyt4zoc

shyt4zoc1#

java.io.ioexception:无法解析地址:ip--xx-xx-xx.ec2。internal:9092
连接到节点ip-172-31-80-50.ec2时出错。internal:9092
当消费者连接到代理时,他们会为正在从中读取数据的分区返回代理的元数据。你的委托人得到的是 advertised.listener Kafka的经纪人。因此,当您通过代理的公共地址连接到代理时,它会将机器的内部地址返回给您的客户机。
要解决这个问题,您需要在代理上正确设置侦听器。看到了吗https://rmoff.net/2018/08/02/kafka-listeners-explained/ 详情。

相关问题