zookeeper会话不断过期…没有心跳?

hjqgdpho  于 2021-06-07  发布在  Kafka
关注(0)|答案(2)|浏览(1251)

我们正在使用kafka高级使用者,我们能够成功地使用消息,但是zookeeper连接不断过期并重新建立。
我想知道为什么没有心跳来维持连接:

Kafka Consumer Logs
====================
 [localhost-startStop-1-SendThread(10.41.105.23:2181)] [ClientCnxn$SendThread] [line : 1096 ]  -  Client session timed out, have not heard from server in 2666ms for sessionid 0x153175bd3860159, closing socket connection and attempting reconnect
2016-03-08 18:00:06,750 INFO  [localhost-startStop-1-SendThread(10.41.105.23:2181)] [ClientCnxn$SendThread] [line : 975 ]  -  Opening socket connection to server 10.41.105.23/10.41.105.23:2181. Will not attempt to authenticate using SASL (unknown error)
2016-03-08 18:00:06,823 INFO  [localhost-startStop-1-SendThread(10.41.105.23:2181)] [ClientCnxn$SendThread] [line : 852 ]  -  Socket connection established to 10.41.105.23/10.41.105.23:2181, initiating session
2016-03-08 18:00:06,892 INFO  [localhost-startStop-1-SendThread(10.41.105.23:2181)] [ClientCnxn$SendThread] [line : 1235 ]  -  Session establishment complete on server 10.41.105.23/10.41.105.23:2181, sessionid = 0x153175bd3860159, negotiated timeout = 4000

Zookeeper Logs
==================
[2016-03-08 17:44:37,722] INFO Accepted socket connection from /10.10.113.92:51333 (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2016-03-08 17:44:37,742] INFO Client attempting to renew session 0x153175bd3860159 at /10.10.113.92:51333 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-03-08 17:44:37,742] INFO Established session 0x153175bd3860159 with negotiated timeout 4000 for client /10.10.113.92:51333 (org.apache.zookeeper.server.ZooKeeperServer)
[2016-03-08 17:46:56,000] INFO Expiring session 0x153175bd3860151, timeout of 4000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
[2016-03-08 17:46:56,001] INFO Processed session termination for sessionid: 0x153175bd3860151 (org.apache.zookeeper.server.PrepRequestProcessor)
[2016-03-08 17:46:56,011] INFO Closed socket connection for client /10.10.114.183:38324 which had sessionid 0x153175bd3860151 (org.apache.zookeeper.server.NIOServerCnxn)
c0vxltue

c0vxltue1#

[2016-03-08 17:46:56000]信息过期会话0x153175bd3860151,超时超过4000ms(org.apache.zookeeper.server.zookeeperserver)
什么是Zookeeper的 maxSessionTimeout ? 如果它只有4000ms(4秒),那么它就太小了。
在hadoop的cloudera发行版中,zk maxSessionTimeout 默认为40秒(40000毫秒)。
如zk配置中所述-https://zookeeper.apache.org/doc/r3.4.5/zookeeperadmin.html 默认值为20 ticks (还有一个) tick 默认值为2秒)。

7d7tgy0s

7d7tgy0s2#

zookeeper会话超时通常是由“软故障”引起的,这通常是垃圾收集暂停。打开gc日志记录,查看连接超时时是否发生长gc。另外,请阅读kafka中的jvm调优。

相关问题