我有一些用python编写的微服务,它们使用faust从kafka生产/消费。当我检查Kafka日志时,我得到了下面的错误。客户机服务、zookeeper和kafka服务器托管在不同pod中的同一eks-kafka集群上。
[2020-12-09 23:37:10,020] ERROR Exception while processing request from <kafka-ip>:9093-<client-ip>:57334-118 (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey: METADATA, apiVersion: 1, connectionId: <kafka-ip>:9093-<client-ip>:57334-118, listenerName: ListenerName(EKSINTERNAL), principal: User:ANONYMOUS
Caused by: org.apache.kafka.common.protocol.types.SchemaException: Error reading field 'topics': Error reading field 'name': String length -1 cannot be negative
at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:118)
at org.apache.kafka.common.protocol.ApiKeys.parseRequest(ApiKeys.java:321)
at org.apache.kafka.common.requests.RequestContext.parseRequest(RequestContext.java:69)
at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:96)
at kafka.network.Processor.$anonfun$processCompletedReceives$1(SocketServer.scala:944)
at java.util.LinkedHashMap$LinkedValues.forEach(LinkedHashMap.java:608)
at kafka.network.Processor.processCompletedReceives(SocketServer.scala:923)
at kafka.network.Processor.run(SocketServer.scala:817)
at java.lang.Thread.run(Thread.java:748)
客户端日志显示连接正在关闭;当我 ss
在kafka pod上,我看到所有这些客户端服务的连接都显示为 ESTABLISHED
. 客户端日志显示:
[2020-12-09 23:47:11,320] [1] [ERROR]: Unable to update metadata from [0]
2020-12-09 23:47:11,320 ERROR _metadata_update(319) Unable to update metadata from [0]
[2020-12-09 23:47:11,320] [1] [ERROR]: Failed fetch messages from 0: ConnectionError: Connection at kafka-0.kafka-hs.default.svc.cluster.local:9093 closed
2020-12-09 23:47:11,320 ERROR _proc_fetch_request(674) Failed fetch messages from 0: ConnectionError: Connection at kafka-0.kafka-hs.default.svc.cluster.local:9093 closed
当我列出这些主题时,我确实看到了它们,但似乎找不到任何其他信息来解决这个问题。系统中没有消息。
容器:ubuntu 16.04
kubernetes api版本:1.16(eks)
Kafka版本/分布:2.6.0/2.13-2.6.0
暂无答案!
目前还没有任何答案,快来回答吧!