You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@zookeeper.apache.org by Cameron McKenzie <ca...@apache.org> on 2016/02/04 00:40:07 UTC
ZOOKEEPER-706
Guys,
We have an application that potentially has over 100k watches at a given
time, and we're running into ZOOKEEPER-706 (
https://issues.apache.org/jira/browse/ZOOKEEPER-706) when reconnecting to
the cluster.
We tried upgrading the client to 3.4.7 (and upgraded the server also even
though looking at the patch I believe it should be a client only fix), but
we're still getting the same problem.
Logs during reconnection below:
2016-02-04 09:15:36,035 [myid:1] - INFO [QuorumPeer[myid=1]/0.0.0.0:2181
:ZooKeeperServer@617] - Established session 0x152a92db7e80000 with
negotiated timeout 10000 for client /10.70.20.57:61918
2016-02-04 09:15:36,193 [myid:1] - WARN [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception causing close of
session 0x152a92db7e80000 due to java.io.IOException: Len error 19780352
2016-02-04 09:15:36,199 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for
client /10.70.20.57:61918 which had sessionid 0x152a92db7e80000
2016-02-04 09:15:40,983 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection
from /10.70.20.57:61922
2016-02-04 09:15:40,984 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:ZooKeeperServer@861] - Client attempting to renew
session 0x152a92db7e80000 at /10.70.20.57:61922
2016-02-04 09:15:40,984 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:Learner@108] - Revalidating client: 0x152a92db7e80000
2016-02-04 09:15:40,986 [myid:1] - INFO [QuorumPeer[myid=1]/0.0.0.0:2181
:ZooKeeperServer@617] - Established session 0x152a92db7e80000 with
negotiated timeout 10000 for client /10.70.20.57:61922
2016-02-04 09:15:50,713 [myid:1] - WARN [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception causing close of
session 0x152a92db7e80000 due to java.io.IOException: Len error 959591480
2016-02-04 09:15:50,737 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for
client /10.70.20.57:61922 which had sessionid 0x152a92db7e80000
2016-02-04 09:16:37,401 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection
from /10.70.20.57:61934
2016-02-04 09:16:37,411 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:ZooKeeperServer@861] - Client attempting to renew
session 0x152a92db7e80000 at /10.70.20.57:61934
2016-02-04 09:16:37,412 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:Learner@108] - Revalidating client: 0x152a92db7e80000
2016-02-04 09:16:37,413 [myid:1] - INFO [QuorumPeer[myid=1]/0.0.0.0:2181
:ZooKeeperServer@617] - Established session 0x152a92db7e80000 with
negotiated timeout 10000 for client /10.70.20.57:61934
2016-02-04 09:16:44,187 [myid:1] - WARN [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:ZooKeeperServer@675] - Received packet at server of
unknown type 1024
2016-02-04 09:16:44,187 [myid:1] - WARN [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception causing close of
session 0x152a92db7e80000 due to java.io.IOException: Len error 1293960047
2016-02-04 09:16:44,199 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for
client /10.70.20.57:61934 which had sessionid 0x152a92db7e80000
2016-02-04 09:16:48,862 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection
from /10.70.20.57:61938
2016-02-04 09:16:48,870 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:ZooKeeperServer@861] - Client attempting to renew
session 0x152a92db7e80000 at /10.70.20.57:61938
2016-02-04 09:16:48,870 [myid:1] - INFO [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:Learner@108] - Revalidating client: 0x152a92db7e80000
2016-02-04 09:16:48,872 [myid:1] - INFO [QuorumPeer[myid=1]/0.0.0.0:2181
:ZooKeeperServer@617] - Established session 0x152a92db7e80000 with
negotiated timeout 10000 for client /10.70.20.57:61938
Any ideas?
cheers
Cam