You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zookeeper.apache.org by "Cameron McKenzie (JIRA)" <ji...@apache.org> on 2016/09/07 04:43:20 UTC

[jira] [Commented] (ZOOKEEPER-1330) Zookeeper server not serving the client request even after completion of Leader election

    [ https://issues.apache.org/jira/browse/ZOOKEEPER-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469525#comment-15469525 ] 

Cameron McKenzie commented on ZOOKEEPER-1330:
---------------------------------------------

Have there been any updates on this? We seem to be running into the same problem. The leader election completes after some period but the nodes are taking 15+ seconds before they stop logging the "ZooKeeperServer no running" message and start processing traffic. This is happening on the leader and followers. See logs excerpts below. After this everything seems to go back to normal.

From the leader:

2016-09-04 01:00:41,024 [myid:5] - INFO  [QuorumPeer[myid=5]/0:0:0:0:0:0:0:0:2181:Leader@358] - LEADING - LEADER ELECTION TOOK - 10251

2016-09-04 01:00:48,814 [myid:5] - INFO  [QuorumPeer[myid=5]/0:0:0:0:0:0:0:0:2181:Leader@943] - Have quorum of supporters, sids: [ 1,2,5 ]; starting up and setting last processed zxid: 0x160000000

From a follower:

2016-09-04 01:00:43,823 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Follower@63] - FOLLOWING - LEADER ELECTION TOOK - 8684

016-09-04 01:00:57,964 [myid:3] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /X.X.X.X:39700
2016-09-04 01:00:57,964 [myid:3] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
2016-09-04 01:00:57,964 [myid:3] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for client /X.X.X.X:39700 (no session established for client)
2016-09-04 01:00:58,055 [myid:3] - WARN  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Follower@118] - Got zxid 0x1600000c80 expected 0x1



> Zookeeper server not serving the client request even after completion of Leader election
> ----------------------------------------------------------------------------------------
>
>                 Key: ZOOKEEPER-1330
>                 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1330
>             Project: ZooKeeper
>          Issue Type: Bug
>          Components: server
>    Affects Versions: 3.4.0
>         Environment: 3 zk quorum
>            Reporter: amith
>            Priority: Minor
>             Fix For: 3.5.3, 3.6.0
>
>
> Have a cluster of 3 zookeepers
> 90 clients are connected to the server
> leader got killed and started
> the other 2 zookeeper started FLE and Leader was elected
> But its taking nearly 10 sec for this server to server requests and saying "ZooKeeperServer not running" message..?
> Why is this even after Leader election SERVER IS NOT RUNNING !!!!!!!!!!
> 2011-12-19 16:12:29,732 [myid:2] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2182:NIOServerCnxn@354] - Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
> 2011-12-19 16:12:29,733 [myid:2] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2182:NIOServerCnxn@1000] - Closed socket connection for client /10.18.47.148:51965 (no session established for client)
> 2011-12-19 16:12:29,753 [myid:2] - INFO  [QuorumPeer[myid=2]/0:0:0:0:0:0:0:0:2182:QuorumPeer@747] - LEADING
> 2011-12-19 16:12:29,762 [myid:2] - INFO  [QuorumPeer[myid=2]/0:0:0:0:0:0:0:0:2182:Leader@58] - TCP NoDelay set to: true
> 2011-12-19 16:12:29,765 [myid:2] - INFO  [QuorumPeer[myid=2]/0:0:0:0:0:0:0:0:2182:ZooKeeperServer@168] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir ../dataDir/version-2 snapdir ../dataDir/version-2
> 2011-12-19 16:12:29,766 [myid:2] - INFO  [QuorumPeer[myid=2]/0:0:0:0:0:0:0:0:2182:Leader@294] - LEADING - LEADER ELECTION TOOK - 4663
> 2011-12-19 16:12:29,776 [myid:2] - INFO  [QuorumPeer[myid=2]/0:0:0:0:0:0:0:0:2182:FileSnap@83] - Reading snapshot ../dataDir/version-2/snapshot.100013661
> 2011-12-19 16:12:29,831 [myid:2] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2182:NIOServerCnxnFactory@213] - Accepted socket connection from /10.18.47.148:51982
> 2011-12-19 16:12:29,831 [myid:2] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2182:NIOServerCnxn@354] - Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
> 2011-12-19 16:12:29,832 [myid:2] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2182:NIOServerCnxn@1000] - Closed socket connection for client /10.18.47.148:51982 (no session established for client)
> 2011-12-19 16:12:29,884 [myid:2] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2182:NIOServerCnxnFactory@213] - Accepted socket connection from /10.18.47.148:51989
> 2011-12-19 16:12:29,884 [myid:2] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2182:NIOServerCnxn@354] - Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)