You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zookeeper.apache.org by "Michael Han (JIRA)" <ji...@apache.org> on 2016/10/08 18:16:22 UTC

[jira] [Updated] (ZOOKEEPER-2493) Flaky Tests: ReconfigTest fails on Solaris

     [ https://issues.apache.org/jira/browse/ZOOKEEPER-2493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Han updated ZOOKEEPER-2493:
-----------------------------------
    Issue Type: Test  (was: Bug)

> Flaky Tests: ReconfigTest fails on Solaris 
> -------------------------------------------
>
>                 Key: ZOOKEEPER-2493
>                 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2493
>             Project: ZooKeeper
>          Issue Type: Test
>          Components: tests
>    Affects Versions: 3.5.0, 3.5.1, 3.5.2
>         Environment: Solaris
>            Reporter: Michael Han
>              Labels: flaky, flaky-test
>             Fix For: 3.5.3
>
>
> Two tests related to ReconfigTest fail consistently on Solaris:
> org.apache.zookeeper.test.ReconfigTest.testPortChangeToBlockedPortLeaderorg.apache.zookeeper.test.ReconfigTest.testPortChangeToBlockedPortFollower
> Examples:
> https://builds.apache.org/view/S-Z/view/ZooKeeper/job/ZooKeeper-trunk-solaris/1245/#showFailuresLink
> https://builds.apache.org/view/S-Z/view/ZooKeeper/job/ZooKeeper_branch35_solaris/185/#showFailuresLink
> {noformat}
> org.apache.zookeeper.test.ReconfigTest.testPortChangeToBlockedPortFollower
> Failing for the past 5 builds (Since Failed#1241 )
> Took 1 min 37 sec.
> Error Message
> client could not connect to reestablished quorum: giving up after 30+ seconds.
> Stacktrace
> junit.framework.AssertionFailedError: client could not connect to reestablished quorum: giving up after 30+ seconds.
> 	at org.apache.zookeeper.test.ReconfigTest.testNormalOperation(ReconfigTest.java:173)
> 	at org.apache.zookeeper.test.ReconfigTest.testPortChangeToBlockedPort(ReconfigTest.java:732)
> 	at org.apache.zookeeper.test.ReconfigTest.testPortChangeToBlockedPortFollower(ReconfigTest.java:658)
> 	at org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)
> Standard Output
> 2016-07-28 09:24:37,121 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No test.method specified. using default methods.
> 2016-07-28 09:24:37,185 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No test.method specified. using default methods.
> 2016-07-28 09:24:37,200 [myid:] - INFO  [main:ZKTestCase$1@55] - STARTING testQuorumSystemChange
> 2016-07-28 09:24:37,202 [myid:] - INFO  [main:JUnit4ZKTestRunner$LoggedInvokeMethod@77] - RUNNING TEST METHOD testQuorumSystemChange
> 2016-07-28 09:24:37,577 [myid:] - INFO  [main:PortAssignment@157] - Single test process using ports from 11221 - 32767.
> 2016-07-28 09:24:37,577 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11222 from range 11221 - 32767.
> 2016-07-28 09:24:37,579 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11223 from range 11221 - 32767.
> 2016-07-28 09:24:37,579 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11224 from range 11221 - 32767.
> 2016-07-28 09:24:37,580 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11225 from range 11221 - 32767.
> 2016-07-28 09:24:37,581 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11226 from range 11221 - 32767.
> 2016-07-28 09:24:37,581 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11227 from range 11221 - 32767.
> 2016-07-28 09:24:37,581 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11228 from range 11221 - 32767.
> 2016-07-28 09:24:37,582 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11229 from range 11221 - 32767.
> 2016-07-28 09:24:37,582 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11230 from range 11221 - 32767.
> 2016-07-28 09:24:37,582 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11231 from range 11221 - 32767.
> 2016-07-28 09:24:37,582 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11232 from range 11221 - 32767.
> 2016-07-28 09:24:37,584 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11233 from range 11221 - 32767.
> 2016-07-28 09:24:37,585 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11234 from range 11221 - 32767.
> 2016-07-28 09:24:37,585 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11235 from range 11221 - 32767.
> 2016-07-28 09:24:37,585 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11236 from range 11221 - 32767.
> 2016-07-28 09:24:37,585 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11237 from range 11221 - 32767.
> 2016-07-28 09:24:37,586 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11238 from range 11221 - 32767.
> 2016-07-28 09:24:37,586 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11239 from range 11221 - 32767.
> 2016-07-28 09:24:37,586 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11240 from range 11221 - 32767.
> 2016-07-28 09:24:37,587 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11241 from range 11221 - 32767.
> 2016-07-28 09:24:37,587 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11242 from range 11221 - 32767.
> 2016-07-28 09:24:37,587 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 1; public port 11222
> 2016-07-28 09:24:37,609 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,615 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11222
> 2016-07-28 09:24:37,638 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 2; public port 11225
> 2016-07-28 09:24:37,638 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,639 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11225
> 2016-07-28 09:24:37,639 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 3; public port 11228
> 2016-07-28 09:24:37,640 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,640 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11228
> 2016-07-28 09:24:37,641 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 4; public port 11231
> 2016-07-28 09:24:37,641 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,641 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11231
> 2016-07-28 09:24:37,642 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 5; public port 11234
> 2016-07-28 09:24:37,642 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,642 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11234
> 2016-07-28 09:24:37,643 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 6; public port 11237
> 2016-07-28 09:24:37,643 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,644 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11237
> 2016-07-28 09:24:37,644 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 7; public port 11240
> 2016-07-28 09:24:37,644 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,645 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11240
> 2016-07-28 09:24:37,646 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,646 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,646 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,646 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,649 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,649 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,651 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11222
> 2016-07-28 09:24:37,651 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11222 is no longer accepting client connections
> 2016-07-28 09:24:37,651 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11225
> 2016-07-28 09:24:37,652 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11225 is no longer accepting client connections
> 2016-07-28 09:24:37,652 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11228
> 2016-07-28 09:24:37,652 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11228 is no longer accepting client connections
> 2016-07-28 09:24:37,652 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11231
> 2016-07-28 09:24:37,653 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11231 is no longer accepting client connections
> 2016-07-28 09:24:37,653 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11234
> 2016-07-28 09:24:37,653 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11234 is no longer accepting client connections
> 2016-07-28 09:24:37,653 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11237
> 2016-07-28 09:24:37,653 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11237 is no longer accepting client connections
> 2016-07-28 09:24:37,654 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11240
> 2016-07-28 09:24:37,654 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11240 is no longer accepting client connections
> 2016-07-28 09:24:37,654 [myid:] - INFO  [main:QuorumUtil@203] - Creating QuorumPeer 1; public port 11222
> 2016-07-28 09:24:37,654 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,655 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11222
> 2016-07-28 09:24:37,660 [myid:] - INFO  [main:QuorumPeer@776] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,708 [myid:] - INFO  [main:QuorumPeer@791] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,754 [myid:] - INFO  [main:QuorumUtil@146] - Started QuorumPeer 1
> 2016-07-28 09:24:37,754 [myid:] - INFO  [main:QuorumUtil@203] - Creating QuorumPeer 2; public port 11225
> 2016-07-28 09:24:37,755 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,755 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11225
> 2016-07-28 09:24:37,756 [myid:] - INFO  [main:QuorumPeer@776] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,759 [myid:] - INFO  [QuorumPeerListener:QuorumCnxManager$Listener@632] - My election bind port: /127.0.0.1:11224
> 2016-07-28 09:24:37,771 [myid:] - INFO  [main:QuorumPeer@791] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,780 [myid:] - INFO  [main:QuorumUtil@146] - Started QuorumPeer 2
> 2016-07-28 09:24:37,780 [myid:] - INFO  [main:QuorumUtil@203] - Creating QuorumPeer 3; public port 11228
> 2016-07-28 09:24:37,781 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,781 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11228
> 2016-07-28 09:24:37,781 [myid:] - INFO  [QuorumPeerListener:QuorumCnxManager$Listener@632] - My election bind port: /127.0.0.1:11227
> 2016-07-28 09:24:37,888 [myid:] - INFO  [main:QuorumPeer@776] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,894 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11222)(secure=disabled):QuorumPeer@1033] - LOOKING
> 2016-07-28 09:24:37,894 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11225)(secure=disabled):QuorumPeer@1033] - LOOKING
> 2016-07-28 09:24:37,895 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11225)(secure=disabled):FastLeaderElection@894] - New election. My id =  2, proposed zxid=0x0
> 2016-07-28 09:24:37,895 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11222)(secure=disabled):FastLeaderElection@894] - New election. My id =  1, proposed zxid=0x0
> 2016-07-28 09:24:37,899 [myid:] - INFO  [/127.0.0.1:11227:QuorumCnxManager$Listener@638] - Received connection request /127.0.0.1:50183
> 2016-07-28 09:24:37,899 [myid:] - INFO  [WorkerSender[myid=1]:QuorumCnxManager@276] - Have smaller server identifier, so dropping the connection: (2, 1)
> 2016-07-28 09:24:37,901 [myid:] - INFO  [/127.0.0.1:11224:QuorumCnxManager$Listener@638] - Received connection request /127.0.0.1:50185
> 2016-07-28 09:24:37,901 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 3 at election address /127.0.0.1:11230
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,905 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,906 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 3 at election address /127.0.0.1:11230
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,906 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,905 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,907 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,908 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,920 [myid:] - INFO  [main:QuorumPeer@791] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,961 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,908 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,962 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,962 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,963 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,963 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,965 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,967 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,968 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,968 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 3 at election address /127.0.0.1:11230
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,969 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,969 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,981 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,982 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,015 [myid:] - INFO  [main:QuorumUtil@146] - Started QuorumPeer 3
> 2016-07-28 09:24:38,016 [myid:] - INFO  [main:QuorumUtil@203] - Creating QuorumPeer 4; public port 11231
> 2016-07-28 09:24:38,016 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:38,017 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11231
> 2016-07-28 09:24:38,017 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11228)(secure=disabled):QuorumPeer@1033] - LOOKING
> 2016-07-28 09:24:38,018 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11228)(secure=disabled):FastLeaderElection@894] - New election. My id =  3, proposed zxid=0x0
> 2016-07-28 09:24:38,018 [myid:] - INFO  [main:QuorumPeer@776] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:38,020 [myid:] - INFO  [QuorumPeerListener:QuorumCnxManager$Listener@632] - My election bind port: /127.0.0.1:11230
> 2016-07-28 09:24:38,025 [myid:] - INFO  [/127.0.0.1:11224:QuorumCnxManager$Listener@638] - Received connection request /127.0.0.1:50200
> 2016-07-28 09:24:38,026 [myid:] - INFO  [/127.0.0.1:11227:QuorumCnxManager$Listener@638] - Received connection request /127.0.0.1:50201
> 2016-07-28 09:24:38,027 [myid:] - WARN  [WorkerSender[myid=3]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,027 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 3 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,028 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 3 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,029 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,029 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,031 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,031 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,031 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 3 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,032 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,032 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,033 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,033 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,032 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,033 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,034 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,035 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,036 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,037 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,037 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,038 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,044 [myid:] - WARN  [WorkerSender[myid=3]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,045 [myid:] - WARN  [WorkerSender[myid=3]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,045 [myid:] - WARN  [WorkerSender[myid=3]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> ...[truncated 3451538 chars]...
> mPeer[myid=1](plain=/127.0.0.1:11371)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id1]
> 2016-07-28 09:30:21,332 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11371)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id1,name1=replica.1]
> 2016-07-28 09:30:21,332 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11371)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id1,name1=replica.2]
> 2016-07-28 09:30:21,332 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11371)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id1,name1=replica.3]
> 2016-07-28 09:30:21,332 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11371)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id1,name1=replica.5]
> 2016-07-28 09:30:21,332 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled)
> 2016-07-28 09:30:21,332 [myid:] - INFO  [main:Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.shutdown(QuorumPeer.java:1184)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdown(QuorumUtil.java:251)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdownAll(QuorumUtil.java:238)
> 	at org.apache.zookeeper.test.QuorumUtil.tearDown(QuorumUtil.java:306)
> 	at org.apache.zookeeper.test.ReconfigTest.tearDown(ReconfigTest.java:64)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
> 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:53)
> 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
> 2016-07-28 09:30:21,333 [myid:] - INFO  [main:LearnerZooKeeperServer@165] - Shutting down
> 2016-07-28 09:30:21,333 [myid:] - INFO  [main:ZooKeeperServer@498] - shutting down
> 2016-07-28 09:30:21,332 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.2,name2=Follower]
> 2016-07-28 09:30:21,333 [myid:] - INFO  [main:FollowerRequestProcessor@138] - Shutting down
> 2016-07-28 09:30:21,333 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1115)
> 2016-07-28 09:30:21,333 [myid:] - INFO  [FollowerRequestProcessor:2:FollowerRequestProcessor@109] - FollowerRequestProcessor exited loop!
> 2016-07-28 09:30:21,333 [myid:] - INFO  [main:CommitProcessor@414] - Shutting down
> 2016-07-28 09:30:21,334 [myid:] - INFO  [CommitProcessor:2:CommitProcessor@299] - CommitProcessor exited loop!
> 2016-07-28 09:30:21,334 [myid:] - INFO  [main:FinalRequestProcessor@479] - shutdown of request processor complete
> 2016-07-28 09:30:21,334 [myid:] - INFO  [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.2,name2=Follower,name3=InMemoryDataTree]
> 2016-07-28 09:30:21,334 [myid:] - INFO  [main:SyncRequestProcessor@191] - Shutting down
> 2016-07-28 09:30:21,334 [myid:] - INFO  [SyncThread:2:SyncRequestProcessor@169] - SyncRequestProcessor exited!
> 2016-07-28 09:30:21,334 [myid:] - WARN  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):QuorumPeer@1158] - PeerState set to LOOKING
> 2016-07-28 09:30:21,335 [myid:] - WARN  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):QuorumPeer@1140] - QuorumPeer main thread exited
> 2016-07-28 09:30:21,335 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2]
> 2016-07-28 09:30:21,335 [myid:] - INFO  [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted
> 2016-07-28 09:30:21,335 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.2]
> 2016-07-28 09:30:21,336 [myid:] - INFO  [NIOServerCxnFactory.AcceptThread:/127.0.0.1:11374:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method
> 2016-07-28 09:30:21,337 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.1]
> 2016-07-28 09:30:21,337 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.3]
> 2016-07-28 09:30:21,337 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:21,337 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.5]
> 2016-07-28 09:30:21,337 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:21,337 [myid:] - INFO  [/127.0.0.1:11376:QuorumCnxManager$Listener@661] - Leaving listener
> 2016-07-28 09:30:21,338 [myid:] - INFO  [main:QuorumUtil@254] - Shutting down leader election QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled)
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled) to exit thread
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled)
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.shutdown(QuorumPeer.java:1184)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdown(QuorumUtil.java:251)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdownAll(QuorumUtil.java:238)
> 	at org.apache.zookeeper.test.QuorumUtil.tearDown(QuorumUtil.java:306)
> 	at org.apache.zookeeper.test.ReconfigTest.tearDown(ReconfigTest.java:64)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
> 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:53)
> 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:LearnerZooKeeperServer@165] - Shutting down
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:ZooKeeperServer@498] - shutting down
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:FollowerRequestProcessor@138] - Shutting down
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:CommitProcessor@414] - Shutting down
> 2016-07-28 09:30:21,339 [myid:] - INFO  [FollowerRequestProcessor:3:FollowerRequestProcessor@109] - FollowerRequestProcessor exited loop!
> 2016-07-28 09:30:21,339 [myid:] - INFO  [CommitProcessor:3:CommitProcessor@299] - CommitProcessor exited loop!
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:FinalRequestProcessor@479] - shutdown of request processor complete
> 2016-07-28 09:30:21,340 [myid:] - INFO  [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.3,name2=Follower,name3=InMemoryDataTree]
> 2016-07-28 09:30:21,340 [myid:] - INFO  [main:SyncRequestProcessor@191] - Shutting down
> 2016-07-28 09:30:21,340 [myid:] - INFO  [SyncThread:3:SyncRequestProcessor@169] - SyncRequestProcessor exited!
> 2016-07-28 09:30:21,340 [myid:] - INFO  [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted
> 2016-07-28 09:30:21,341 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:21,341 [myid:] - INFO  [NIOServerCxnFactory.AcceptThread:/127.0.0.1:11377:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method
> 2016-07-28 09:30:21,342 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:21,342 [myid:] - INFO  [/127.0.0.1:11379:QuorumCnxManager$Listener@661] - Leaving listener
> 2016-07-28 09:30:21,343 [myid:] - INFO  [main:QuorumUtil@254] - Shutting down leader election QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled)
> 2016-07-28 09:30:21,343 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled) to exit thread
> 2016-07-28 09:30:21,421 [myid:127.0.0.1:11273] - INFO  [main-SendThread(127.0.0.1:11273):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11273. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:21,422 [myid:127.0.0.1:11273] - ERROR [main-SendThread(127.0.0.1:11273):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11273
> 2016-07-28 09:30:21,422 [myid:127.0.0.1:11273] - WARN  [main-SendThread(127.0.0.1:11273):ClientCnxn$SendThread@1235] - Session 0x222add090c60000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:21,451 [myid:127.0.0.1:11257] - INFO  [main-SendThread(127.0.0.1:11257):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11257. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:21,451 [myid:127.0.0.1:11257] - ERROR [main-SendThread(127.0.0.1:11257):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11257
> 2016-07-28 09:30:21,451 [myid:127.0.0.1:11257] - WARN  [main-SendThread(127.0.0.1:11257):ClientCnxn$SendThread@1235] - Session 0x122adcf0ae70000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:21,671 [myid:127.0.0.1:11276] - INFO  [main-SendThread(127.0.0.1:11276):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11276. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:21,671 [myid:127.0.0.1:11276] - ERROR [main-SendThread(127.0.0.1:11276):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11276
> 2016-07-28 09:30:21,671 [myid:127.0.0.1:11276] - WARN  [main-SendThread(127.0.0.1:11276):ClientCnxn$SendThread@1235] - Session 0x322add08d0d0000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:21,991 [myid:127.0.0.1:11306] - INFO  [main-SendThread(127.0.0.1:11306):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11306. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:21,991 [myid:127.0.0.1:11306] - ERROR [main-SendThread(127.0.0.1:11306):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11306
> 2016-07-28 09:30:21,991 [myid:127.0.0.1:11306] - WARN  [main-SendThread(127.0.0.1:11306):ClientCnxn$SendThread@1235] - Session 0x222add109d00000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,091 [myid:127.0.0.1:11263] - INFO  [main-SendThread(127.0.0.1:11263):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11263. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:22,091 [myid:127.0.0.1:11263] - ERROR [main-SendThread(127.0.0.1:11263):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11263
> 2016-07-28 09:30:22,091 [myid:127.0.0.1:11263] - WARN  [main-SendThread(127.0.0.1:11263):ClientCnxn$SendThread@1235] - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,111 [myid:127.0.0.1:11303] - INFO  [main-SendThread(127.0.0.1:11303):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11303. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:22,111 [myid:127.0.0.1:11303] - ERROR [main-SendThread(127.0.0.1:11303):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11303
> 2016-07-28 09:30:22,111 [myid:127.0.0.1:11303] - WARN  [main-SendThread(127.0.0.1:11303):ClientCnxn$SendThread@1235] - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,241 [myid:127.0.0.1:11270] - INFO  [main-SendThread(127.0.0.1:11270):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11270. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:22,241 [myid:127.0.0.1:11270] - ERROR [main-SendThread(127.0.0.1:11270):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11270
> 2016-07-28 09:30:22,241 [myid:127.0.0.1:11270] - WARN  [main-SendThread(127.0.0.1:11270):ClientCnxn$SendThread@1235] - Session 0x122add08ccf0000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,341 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.3,name2=Follower]
> 2016-07-28 09:30:22,341 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1115)
> 2016-07-28 09:30:22,341 [myid:] - WARN  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):QuorumPeer@1158] - PeerState set to LOOKING
> 2016-07-28 09:30:22,341 [myid:] - WARN  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):QuorumPeer@1140] - QuorumPeer main thread exited
> 2016-07-28 09:30:22,341 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3]
> 2016-07-28 09:30:22,342 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.3]
> 2016-07-28 09:30:22,342 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.1]
> 2016-07-28 09:30:22,342 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.2]
> 2016-07-28 09:30:22,342 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.5]
> 2016-07-28 09:30:22,342 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled)
> 2016-07-28 09:30:22,342 [myid:] - INFO  [main:Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.shutdown(QuorumPeer.java:1184)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdown(QuorumUtil.java:251)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdownAll(QuorumUtil.java:238)
> 	at org.apache.zookeeper.test.QuorumUtil.tearDown(QuorumUtil.java:306)
> 	at org.apache.zookeeper.test.ReconfigTest.tearDown(ReconfigTest.java:64)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
> 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:53)
> 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
> 2016-07-28 09:30:22,342 [myid:] - INFO  [main:LearnerZooKeeperServer@165] - Shutting down
> 2016-07-28 09:30:22,342 [myid:] - INFO  [main:ZooKeeperServer@498] - shutting down
> 2016-07-28 09:30:22,343 [myid:] - INFO  [main:FollowerRequestProcessor@138] - Shutting down
> 2016-07-28 09:30:22,343 [myid:] - INFO  [main:CommitProcessor@414] - Shutting down
> 2016-07-28 09:30:22,343 [myid:] - INFO  [FollowerRequestProcessor:4:FollowerRequestProcessor@109] - FollowerRequestProcessor exited loop!
> 2016-07-28 09:30:22,343 [myid:] - INFO  [CommitProcessor:4:CommitProcessor@299] - CommitProcessor exited loop!
> 2016-07-28 09:30:22,343 [myid:] - INFO  [main:FinalRequestProcessor@479] - shutdown of request processor complete
> 2016-07-28 09:30:22,344 [myid:] - INFO  [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.4,name2=Follower,name3=InMemoryDataTree]
> 2016-07-28 09:30:22,344 [myid:] - INFO  [main:SyncRequestProcessor@191] - Shutting down
> 2016-07-28 09:30:22,344 [myid:] - INFO  [SyncThread:4:SyncRequestProcessor@169] - SyncRequestProcessor exited!
> 2016-07-28 09:30:22,344 [myid:] - INFO  [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted
> 2016-07-28 09:30:22,345 [myid:] - INFO  [NIOServerCxnFactory.AcceptThread:/127.0.0.1:11380:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method
> 2016-07-28 09:30:22,345 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:22,345 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:22,346 [myid:] - INFO  [/127.0.0.1:11382:QuorumCnxManager$Listener@661] - Leaving listener
> 2016-07-28 09:30:22,346 [myid:] - INFO  [main:QuorumUtil@254] - Shutting down leader election QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled)
> 2016-07-28 09:30:22,346 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled) to exit thread
> 2016-07-28 09:30:22,521 [myid:127.0.0.1:11309] - INFO  [main-SendThread(127.0.0.1:11309):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11309. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:22,521 [myid:127.0.0.1:11309] - ERROR [main-SendThread(127.0.0.1:11309):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11309
> 2016-07-28 09:30:22,521 [myid:127.0.0.1:11309] - WARN  [main-SendThread(127.0.0.1:11309):ClientCnxn$SendThread@1235] - Session 0x322add109d50000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,631 [myid:127.0.0.1:11273] - INFO  [main-SendThread(127.0.0.1:11273):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11273. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:22,631 [myid:127.0.0.1:11273] - ERROR [main-SendThread(127.0.0.1:11273):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11273
> 2016-07-28 09:30:22,631 [myid:127.0.0.1:11273] - WARN  [main-SendThread(127.0.0.1:11273):ClientCnxn$SendThread@1235] - Session 0x222add090c60000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,761 [myid:] - INFO  [WorkerReceiver[myid=4]:FastLeaderElection$Messenger$WorkerReceiver@440] - WorkerReceiver is down
> 2016-07-28 09:30:22,761 [myid:] - INFO  [WorkerSender[myid=4]:FastLeaderElection$Messenger$WorkerSender@470] - WorkerSender is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection$Messenger$WorkerReceiver@440] - WorkerReceiver is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerSender[myid=1]:FastLeaderElection$Messenger$WorkerSender@470] - WorkerSender is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerSender[myid=2]:FastLeaderElection$Messenger$WorkerSender@470] - WorkerSender is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@440] - WorkerReceiver is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@440] - WorkerReceiver is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerSender[myid=3]:FastLeaderElection$Messenger$WorkerSender@470] - WorkerSender is down
> 2016-07-28 09:30:23,061 [myid:127.0.0.1:11260] - INFO  [main-SendThread(127.0.0.1:11260):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11260. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:23,061 [myid:127.0.0.1:11260] - ERROR [main-SendThread(127.0.0.1:11260):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11260
> 2016-07-28 09:30:23,061 [myid:127.0.0.1:11260] - WARN  [main-SendThread(127.0.0.1:11260):ClientCnxn$SendThread@1235] - Session 0x222adcf0da20000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:23,211 [myid:127.0.0.1:11263] - INFO  [main-SendThread(127.0.0.1:11263):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11263. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:23,211 [myid:127.0.0.1:11263] - ERROR [main-SendThread(127.0.0.1:11263):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11263
> 2016-07-28 09:30:23,211 [myid:127.0.0.1:11263] - WARN  [main-SendThread(127.0.0.1:11263):ClientCnxn$SendThread@1235] - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:23,231 [myid:127.0.0.1:11303] - INFO  [main-SendThread(127.0.0.1:11303):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11303. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:23,231 [myid:127.0.0.1:11276] - INFO  [main-SendThread(127.0.0.1:11276):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11276. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:23,231 [myid:127.0.0.1:11303] - ERROR [main-SendThread(127.0.0.1:11303):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11303
> 2016-07-28 09:30:23,231 [myid:127.0.0.1:11303] - WARN  [main-SendThread(127.0.0.1:11303):ClientCnxn$SendThread@1235] - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:23,231 [myid:127.0.0.1:11276] - ERROR [main-SendThread(127.0.0.1:11276):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11276
> 2016-07-28 09:30:23,232 [myid:127.0.0.1:11276] - WARN  [main-SendThread(127.0.0.1:11276):ClientCnxn$SendThread@1235] - Session 0x322add08d0d0000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:23,341 [myid:127.0.0.1:11257] - INFO  [main-SendThread(127.0.0.1:11257):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11257. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:23,341 [myid:127.0.0.1:11257] - ERROR [main-SendThread(127.0.0.1:11257):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11257
> 2016-07-28 09:30:23,341 [myid:127.0.0.1:11257] - WARN  [main-SendThread(127.0.0.1:11257):ClientCnxn$SendThread@1235] - Session 0x122adcf0ae70000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:23,351 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.4,name2=Follower]
> 2016-07-28 09:30:23,351 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1115)
> 2016-07-28 09:30:23,351 [myid:] - WARN  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):QuorumPeer@1158] - PeerState set to LOOKING
> 2016-07-28 09:30:23,351 [myid:] - WARN  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):QuorumPeer@1140] - QuorumPeer main thread exited
> 2016-07-28 09:30:23,351 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.4]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.1]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.2]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.3]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.5]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled)
> 2016-07-28 09:30:23,352 [myid:] - INFO  [main:Leader@617] - Shutting down
> 2016-07-28 09:30:23,352 [myid:] - INFO  [main:Leader@623] - Shutdown called
> java.lang.Exception: shutdown Leader! reason: quorum Peer shutdown
> 	at org.apache.zookeeper.server.quorum.Leader.shutdown(Leader.java:623)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.shutdown(QuorumPeer.java:1181)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdown(QuorumUtil.java:251)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdownAll(QuorumUtil.java:238)
> 	at org.apache.zookeeper.test.QuorumUtil.tearDown(QuorumUtil.java:306)
> 	at org.apache.zookeeper.test.ReconfigTest.tearDown(ReconfigTest.java:64)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
> 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:53)
> 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
> 2016-07-28 09:30:23,353 [myid:] - INFO  [main:ZooKeeperServer@498] - shutting down
> 2016-07-28 09:30:23,353 [myid:] - INFO  [main:SessionTrackerImpl@232] - Shutting down
> 2016-07-28 09:30:23,353 [myid:] - INFO  [main:LeaderRequestProcessor@77] - Shutting down
> 2016-07-28 09:30:23,353 [myid:] - INFO  [main:PrepRequestProcessor@965] - Shutting down
> 2016-07-28 09:30:23,353 [myid:] - INFO  [LearnerCnxAcceptor-/127.0.0.1:11384:Leader$LearnerCnxAcceptor@373] - exception while shutting down acceptor: java.net.SocketException: Socket closed
> 2016-07-28 09:30:23,353 [myid:] - INFO  [ProcessThread(sid:5 cport:-1)::PrepRequestProcessor@154] - PrepRequestProcessor exited loop!
> 2016-07-28 09:30:23,353 [myid:] - INFO  [main:ProposalRequestProcessor@88] - Shutting down
> 2016-07-28 09:30:23,354 [myid:] - INFO  [main:CommitProcessor@414] - Shutting down
> 2016-07-28 09:30:23,354 [myid:] - INFO  [CommitProcessor:5:CommitProcessor@299] - CommitProcessor exited loop!
> 2016-07-28 09:30:23,354 [myid:] - INFO  [main:Leader$ToBeAppliedRequestProcessor@918] - Shutting down
> 2016-07-28 09:30:23,354 [myid:] - INFO  [main:FinalRequestProcessor@479] - shutdown of request processor complete
> 2016-07-28 09:30:23,354 [myid:] - INFO  [main:SyncRequestProcessor@191] - Shutting down
> 2016-07-28 09:30:23,354 [myid:] - INFO  [SyncThread:5:SyncRequestProcessor@169] - SyncRequestProcessor exited!
> 2016-07-28 09:30:23,355 [myid:] - INFO  [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.5,name2=Leader,name3=InMemoryDataTree]
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51992:LearnerHandler@619] - ******* GOODBYE /127.0.0.1:51992 ********
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51977:LearnerHandler@619] - ******* GOODBYE /127.0.0.1:51977 ********
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51992:LearnerHandler@903] - Ignoring unexpected exception
> java.lang.InterruptedException
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219)
> 	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340)
> 	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.shutdown(LearnerHandler.java:901)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:622)
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51976:LearnerHandler@619] - ******* GOODBYE /127.0.0.1:51976 ********
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51975:LearnerHandler@619] - ******* GOODBYE /127.0.0.1:51975 ********
> 2016-07-28 09:30:23,356 [myid:] - INFO  [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted
> 2016-07-28 09:30:23,356 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51977:LearnerHandler@903] - Ignoring unexpected exception
> java.lang.InterruptedException
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219)
> 	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340)
> 	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.shutdown(LearnerHandler.java:901)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:622)
> 2016-07-28 09:30:23,356 [myid:] - INFO  [NIOServerCxnFactory.AcceptThread:/127.0.0.1:11383:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method
> 2016-07-28 09:30:23,356 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:23,356 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51975:LearnerHandler@903] - Ignoring unexpected exception
> java.lang.InterruptedException
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219)
> 	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340)
> 	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.shutdown(LearnerHandler.java:901)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:622)
> 2016-07-28 09:30:23,356 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51976:LearnerHandler@903] - Ignoring unexpected exception
> java.lang.InterruptedException
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219)
> 	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340)
> 	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.shutdown(LearnerHandler.java:901)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:622)
> 2016-07-28 09:30:23,357 [myid:] - INFO  [/127.0.0.1:11385:QuorumCnxManager$Listener@661] - Leaving listener
> 2016-07-28 09:30:23,357 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.5,name2=Leader]
> 2016-07-28 09:30:23,358 [myid:] - INFO  [main:QuorumUtil@254] - Shutting down leader election QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled)
> 2016-07-28 09:30:23,358 [myid:] - WARN  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):QuorumPeer@1127] - Unexpected exception
> java.lang.InterruptedException
> 	at java.lang.Object.wait(Native Method)
> 	at org.apache.zookeeper.server.quorum.Leader.lead(Leader.java:561)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1124)
> 2016-07-28 09:30:23,358 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):Leader@617] - Shutting down
> 2016-07-28 09:30:23,358 [myid:] - WARN  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):QuorumPeer@1158] - PeerState set to LOOKING
> 2016-07-28 09:30:23,358 [myid:] - WARN  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):QuorumPeer@1140] - QuorumPeer main thread exited
> 2016-07-28 09:30:23,358 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled) to exit thread
> 2016-07-28 09:30:23,358 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5]
> 2016-07-28 09:30:23,359 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.5]
> 2016-07-28 09:30:23,359 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.1]
> 2016-07-28 09:30:23,359 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.2]
> 2016-07-28 09:30:23,359 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.3]
> 2016-07-28 09:30:23,359 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11371
> 2016-07-28 09:30:23,359 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11371 is no longer accepting client connections
> 2016-07-28 09:30:23,359 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11374
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11374 is no longer accepting client connections
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11377
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11377 is no longer accepting client connections
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11380
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11380 is no longer accepting client connections
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11383
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11383 is no longer accepting client connections
> 2016-07-28 09:30:23,361 [myid:] - INFO  [main:ZKTestCase$1@65] - SUCCEEDED testRemoveOneAsynchronous
> 2016-07-28 09:30:23,361 [myid:] - INFO  [main:ZKTestCase$1@60] - FINISHED testRemoveOneAsynchronous
> {noformat}
> {noformat}
> Failed
> org.apache.zookeeper.test.ReconfigTest.testPortChangeToBlockedPortLeader
> Failing for the past 5 builds (Since Failed#1241 )
> Took 1 min 38 sec.
> Error Message
> client could not connect to reestablished quorum: giving up after 30+ seconds.
> Stacktrace
> junit.framework.AssertionFailedError: client could not connect to reestablished quorum: giving up after 30+ seconds.
> 	at org.apache.zookeeper.test.ReconfigTest.testNormalOperation(ReconfigTest.java:173)
> 	at org.apache.zookeeper.test.ReconfigTest.testPortChangeToBlockedPort(ReconfigTest.java:732)
> 	at org.apache.zookeeper.test.ReconfigTest.testPortChangeToBlockedPortLeader(ReconfigTest.java:662)
> 	at org.apache.zookeeper.JUnit4ZKTestRunner$LoggedInvokeMethod.evaluate(JUnit4ZKTestRunner.java:79)
> Standard Output
> 2016-07-28 09:24:37,121 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No test.method specified. using default methods.
> 2016-07-28 09:24:37,185 [myid:] - INFO  [main:JUnit4ZKTestRunner@47] - No test.method specified. using default methods.
> 2016-07-28 09:24:37,200 [myid:] - INFO  [main:ZKTestCase$1@55] - STARTING testQuorumSystemChange
> 2016-07-28 09:24:37,202 [myid:] - INFO  [main:JUnit4ZKTestRunner$LoggedInvokeMethod@77] - RUNNING TEST METHOD testQuorumSystemChange
> 2016-07-28 09:24:37,577 [myid:] - INFO  [main:PortAssignment@157] - Single test process using ports from 11221 - 32767.
> 2016-07-28 09:24:37,577 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11222 from range 11221 - 32767.
> 2016-07-28 09:24:37,579 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11223 from range 11221 - 32767.
> 2016-07-28 09:24:37,579 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11224 from range 11221 - 32767.
> 2016-07-28 09:24:37,580 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11225 from range 11221 - 32767.
> 2016-07-28 09:24:37,581 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11226 from range 11221 - 32767.
> 2016-07-28 09:24:37,581 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11227 from range 11221 - 32767.
> 2016-07-28 09:24:37,581 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11228 from range 11221 - 32767.
> 2016-07-28 09:24:37,582 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11229 from range 11221 - 32767.
> 2016-07-28 09:24:37,582 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11230 from range 11221 - 32767.
> 2016-07-28 09:24:37,582 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11231 from range 11221 - 32767.
> 2016-07-28 09:24:37,582 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11232 from range 11221 - 32767.
> 2016-07-28 09:24:37,584 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11233 from range 11221 - 32767.
> 2016-07-28 09:24:37,585 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11234 from range 11221 - 32767.
> 2016-07-28 09:24:37,585 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11235 from range 11221 - 32767.
> 2016-07-28 09:24:37,585 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11236 from range 11221 - 32767.
> 2016-07-28 09:24:37,585 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11237 from range 11221 - 32767.
> 2016-07-28 09:24:37,586 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11238 from range 11221 - 32767.
> 2016-07-28 09:24:37,586 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11239 from range 11221 - 32767.
> 2016-07-28 09:24:37,586 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11240 from range 11221 - 32767.
> 2016-07-28 09:24:37,587 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11241 from range 11221 - 32767.
> 2016-07-28 09:24:37,587 [myid:] - INFO  [main:PortAssignment@85] - Assigned port 11242 from range 11221 - 32767.
> 2016-07-28 09:24:37,587 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 1; public port 11222
> 2016-07-28 09:24:37,609 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,615 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11222
> 2016-07-28 09:24:37,638 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 2; public port 11225
> 2016-07-28 09:24:37,638 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,639 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11225
> 2016-07-28 09:24:37,639 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 3; public port 11228
> 2016-07-28 09:24:37,640 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,640 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11228
> 2016-07-28 09:24:37,641 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 4; public port 11231
> 2016-07-28 09:24:37,641 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,641 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11231
> 2016-07-28 09:24:37,642 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 5; public port 11234
> 2016-07-28 09:24:37,642 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,642 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11234
> 2016-07-28 09:24:37,643 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 6; public port 11237
> 2016-07-28 09:24:37,643 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,644 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11237
> 2016-07-28 09:24:37,644 [myid:] - INFO  [main:QuorumUtil@116] - Creating QuorumPeer 7; public port 11240
> 2016-07-28 09:24:37,644 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,645 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11240
> 2016-07-28 09:24:37,646 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,646 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,646 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,646 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,647 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,648 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer
> 2016-07-28 09:24:37,649 [myid:] - INFO  [main:QuorumUtil@257] - No election available to shutdown QuorumPeer
> 2016-07-28 09:24:37,649 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer to exit thread
> 2016-07-28 09:24:37,651 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11222
> 2016-07-28 09:24:37,651 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11222 is no longer accepting client connections
> 2016-07-28 09:24:37,651 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11225
> 2016-07-28 09:24:37,652 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11225 is no longer accepting client connections
> 2016-07-28 09:24:37,652 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11228
> 2016-07-28 09:24:37,652 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11228 is no longer accepting client connections
> 2016-07-28 09:24:37,652 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11231
> 2016-07-28 09:24:37,653 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11231 is no longer accepting client connections
> 2016-07-28 09:24:37,653 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11234
> 2016-07-28 09:24:37,653 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11234 is no longer accepting client connections
> 2016-07-28 09:24:37,653 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11237
> 2016-07-28 09:24:37,653 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11237 is no longer accepting client connections
> 2016-07-28 09:24:37,654 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11240
> 2016-07-28 09:24:37,654 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11240 is no longer accepting client connections
> 2016-07-28 09:24:37,654 [myid:] - INFO  [main:QuorumUtil@203] - Creating QuorumPeer 1; public port 11222
> 2016-07-28 09:24:37,654 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,655 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11222
> 2016-07-28 09:24:37,660 [myid:] - INFO  [main:QuorumPeer@776] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,708 [myid:] - INFO  [main:QuorumPeer@791] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,754 [myid:] - INFO  [main:QuorumUtil@146] - Started QuorumPeer 1
> 2016-07-28 09:24:37,754 [myid:] - INFO  [main:QuorumUtil@203] - Creating QuorumPeer 2; public port 11225
> 2016-07-28 09:24:37,755 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,755 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11225
> 2016-07-28 09:24:37,756 [myid:] - INFO  [main:QuorumPeer@776] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,759 [myid:] - INFO  [QuorumPeerListener:QuorumCnxManager$Listener@632] - My election bind port: /127.0.0.1:11224
> 2016-07-28 09:24:37,771 [myid:] - INFO  [main:QuorumPeer@791] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,780 [myid:] - INFO  [main:QuorumUtil@146] - Started QuorumPeer 2
> 2016-07-28 09:24:37,780 [myid:] - INFO  [main:QuorumUtil@203] - Creating QuorumPeer 3; public port 11228
> 2016-07-28 09:24:37,781 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:37,781 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11228
> 2016-07-28 09:24:37,781 [myid:] - INFO  [QuorumPeerListener:QuorumCnxManager$Listener@632] - My election bind port: /127.0.0.1:11227
> 2016-07-28 09:24:37,888 [myid:] - INFO  [main:QuorumPeer@776] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,894 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11222)(secure=disabled):QuorumPeer@1033] - LOOKING
> 2016-07-28 09:24:37,894 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11225)(secure=disabled):QuorumPeer@1033] - LOOKING
> 2016-07-28 09:24:37,895 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11225)(secure=disabled):FastLeaderElection@894] - New election. My id =  2, proposed zxid=0x0
> 2016-07-28 09:24:37,895 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11222)(secure=disabled):FastLeaderElection@894] - New election. My id =  1, proposed zxid=0x0
> 2016-07-28 09:24:37,899 [myid:] - INFO  [/127.0.0.1:11227:QuorumCnxManager$Listener@638] - Received connection request /127.0.0.1:50183
> 2016-07-28 09:24:37,899 [myid:] - INFO  [WorkerSender[myid=1]:QuorumCnxManager@276] - Have smaller server identifier, so dropping the connection: (2, 1)
> 2016-07-28 09:24:37,901 [myid:] - INFO  [/127.0.0.1:11224:QuorumCnxManager$Listener@638] - Received connection request /127.0.0.1:50185
> 2016-07-28 09:24:37,901 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 3 at election address /127.0.0.1:11230
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,905 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,906 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 3 at election address /127.0.0.1:11230
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,906 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,905 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,907 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,908 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,920 [myid:] - INFO  [main:QuorumPeer@791] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:37,961 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,908 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,962 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,962 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,963 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,963 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,965 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,967 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,968 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:37,968 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 3 at election address /127.0.0.1:11230
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,969 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,969 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,981 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:37,982 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,015 [myid:] - INFO  [main:QuorumUtil@146] - Started QuorumPeer 3
> 2016-07-28 09:24:38,016 [myid:] - INFO  [main:QuorumUtil@203] - Creating QuorumPeer 4; public port 11231
> 2016-07-28 09:24:38,016 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
> 2016-07-28 09:24:38,017 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - binding to port /127.0.0.1:11231
> 2016-07-28 09:24:38,017 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11228)(secure=disabled):QuorumPeer@1033] - LOOKING
> 2016-07-28 09:24:38,018 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11228)(secure=disabled):FastLeaderElection@894] - New election. My id =  3, proposed zxid=0x0
> 2016-07-28 09:24:38,018 [myid:] - INFO  [main:QuorumPeer@776] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
> 2016-07-28 09:24:38,020 [myid:] - INFO  [QuorumPeerListener:QuorumCnxManager$Listener@632] - My election bind port: /127.0.0.1:11230
> 2016-07-28 09:24:38,025 [myid:] - INFO  [/127.0.0.1:11224:QuorumCnxManager$Listener@638] - Received connection request /127.0.0.1:50200
> 2016-07-28 09:24:38,026 [myid:] - INFO  [/127.0.0.1:11227:QuorumCnxManager$Listener@638] - Received connection request /127.0.0.1:50201
> 2016-07-28 09:24:38,027 [myid:] - WARN  [WorkerSender[myid=3]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,027 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 3 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,028 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 3 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,029 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,029 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,031 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,031 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,031 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 3 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,032 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,032 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,033 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,033 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,032 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@688] - Notification: 2 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,033 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 4 at election address /127.0.0.1:11233
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,034 [myid:] - WARN  [WorkerSender[myid=1]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,035 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,036 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,037 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@688] - Notification: 2 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)0 (n.config version)
> 2016-07-28 09:24:38,037 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,038 [myid:] - WARN  [WorkerSender[myid=2]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,044 [myid:] - WARN  [WorkerSender[myid=3]:QuorumCnxManager@455] - Cannot open channel to 5 at election address /127.0.0.1:11236
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,045 [myid:] - WARN  [WorkerSender[myid=3]:QuorumCnxManager@455] - Cannot open channel to 6 at election address /127.0.0.1:11239
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> 	at java.net.Socket.connect(Socket.java:579)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:441)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:482)
> 	at org.apache.zookeeper.server.quorum.QuorumCnxManager.toSend(QuorumCnxManager.java:419)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.process(FastLeaderElection.java:486)
> 	at org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:465)
> 	at java.lang.Thread.run(Thread.java:745)
> 2016-07-28 09:24:38,045 [myid:] - WARN  [WorkerSender[myid=3]:QuorumCnxManager@455] - Cannot open channel to 7 at election address /127.0.0.1:11242
> java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> ...[truncated 3451538 chars]...
> mPeer[myid=1](plain=/127.0.0.1:11371)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id1]
> 2016-07-28 09:30:21,332 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11371)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id1,name1=replica.1]
> 2016-07-28 09:30:21,332 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11371)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id1,name1=replica.2]
> 2016-07-28 09:30:21,332 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11371)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id1,name1=replica.3]
> 2016-07-28 09:30:21,332 [myid:] - INFO  [QuorumPeer[myid=1](plain=/127.0.0.1:11371)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id1,name1=replica.5]
> 2016-07-28 09:30:21,332 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled)
> 2016-07-28 09:30:21,332 [myid:] - INFO  [main:Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.shutdown(QuorumPeer.java:1184)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdown(QuorumUtil.java:251)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdownAll(QuorumUtil.java:238)
> 	at org.apache.zookeeper.test.QuorumUtil.tearDown(QuorumUtil.java:306)
> 	at org.apache.zookeeper.test.ReconfigTest.tearDown(ReconfigTest.java:64)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
> 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:53)
> 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
> 2016-07-28 09:30:21,333 [myid:] - INFO  [main:LearnerZooKeeperServer@165] - Shutting down
> 2016-07-28 09:30:21,333 [myid:] - INFO  [main:ZooKeeperServer@498] - shutting down
> 2016-07-28 09:30:21,332 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.2,name2=Follower]
> 2016-07-28 09:30:21,333 [myid:] - INFO  [main:FollowerRequestProcessor@138] - Shutting down
> 2016-07-28 09:30:21,333 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1115)
> 2016-07-28 09:30:21,333 [myid:] - INFO  [FollowerRequestProcessor:2:FollowerRequestProcessor@109] - FollowerRequestProcessor exited loop!
> 2016-07-28 09:30:21,333 [myid:] - INFO  [main:CommitProcessor@414] - Shutting down
> 2016-07-28 09:30:21,334 [myid:] - INFO  [CommitProcessor:2:CommitProcessor@299] - CommitProcessor exited loop!
> 2016-07-28 09:30:21,334 [myid:] - INFO  [main:FinalRequestProcessor@479] - shutdown of request processor complete
> 2016-07-28 09:30:21,334 [myid:] - INFO  [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.2,name2=Follower,name3=InMemoryDataTree]
> 2016-07-28 09:30:21,334 [myid:] - INFO  [main:SyncRequestProcessor@191] - Shutting down
> 2016-07-28 09:30:21,334 [myid:] - INFO  [SyncThread:2:SyncRequestProcessor@169] - SyncRequestProcessor exited!
> 2016-07-28 09:30:21,334 [myid:] - WARN  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):QuorumPeer@1158] - PeerState set to LOOKING
> 2016-07-28 09:30:21,335 [myid:] - WARN  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):QuorumPeer@1140] - QuorumPeer main thread exited
> 2016-07-28 09:30:21,335 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2]
> 2016-07-28 09:30:21,335 [myid:] - INFO  [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted
> 2016-07-28 09:30:21,335 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.2]
> 2016-07-28 09:30:21,336 [myid:] - INFO  [NIOServerCxnFactory.AcceptThread:/127.0.0.1:11374:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method
> 2016-07-28 09:30:21,337 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.1]
> 2016-07-28 09:30:21,337 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.3]
> 2016-07-28 09:30:21,337 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:21,337 [myid:] - INFO  [QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id2,name1=replica.5]
> 2016-07-28 09:30:21,337 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:21,337 [myid:] - INFO  [/127.0.0.1:11376:QuorumCnxManager$Listener@661] - Leaving listener
> 2016-07-28 09:30:21,338 [myid:] - INFO  [main:QuorumUtil@254] - Shutting down leader election QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled)
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer[myid=2](plain=/127.0.0.1:11374)(secure=disabled) to exit thread
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled)
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.shutdown(QuorumPeer.java:1184)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdown(QuorumUtil.java:251)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdownAll(QuorumUtil.java:238)
> 	at org.apache.zookeeper.test.QuorumUtil.tearDown(QuorumUtil.java:306)
> 	at org.apache.zookeeper.test.ReconfigTest.tearDown(ReconfigTest.java:64)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
> 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:53)
> 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:LearnerZooKeeperServer@165] - Shutting down
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:ZooKeeperServer@498] - shutting down
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:FollowerRequestProcessor@138] - Shutting down
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:CommitProcessor@414] - Shutting down
> 2016-07-28 09:30:21,339 [myid:] - INFO  [FollowerRequestProcessor:3:FollowerRequestProcessor@109] - FollowerRequestProcessor exited loop!
> 2016-07-28 09:30:21,339 [myid:] - INFO  [CommitProcessor:3:CommitProcessor@299] - CommitProcessor exited loop!
> 2016-07-28 09:30:21,339 [myid:] - INFO  [main:FinalRequestProcessor@479] - shutdown of request processor complete
> 2016-07-28 09:30:21,340 [myid:] - INFO  [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.3,name2=Follower,name3=InMemoryDataTree]
> 2016-07-28 09:30:21,340 [myid:] - INFO  [main:SyncRequestProcessor@191] - Shutting down
> 2016-07-28 09:30:21,340 [myid:] - INFO  [SyncThread:3:SyncRequestProcessor@169] - SyncRequestProcessor exited!
> 2016-07-28 09:30:21,340 [myid:] - INFO  [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted
> 2016-07-28 09:30:21,341 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:21,341 [myid:] - INFO  [NIOServerCxnFactory.AcceptThread:/127.0.0.1:11377:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method
> 2016-07-28 09:30:21,342 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:21,342 [myid:] - INFO  [/127.0.0.1:11379:QuorumCnxManager$Listener@661] - Leaving listener
> 2016-07-28 09:30:21,343 [myid:] - INFO  [main:QuorumUtil@254] - Shutting down leader election QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled)
> 2016-07-28 09:30:21,343 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled) to exit thread
> 2016-07-28 09:30:21,421 [myid:127.0.0.1:11273] - INFO  [main-SendThread(127.0.0.1:11273):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11273. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:21,422 [myid:127.0.0.1:11273] - ERROR [main-SendThread(127.0.0.1:11273):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11273
> 2016-07-28 09:30:21,422 [myid:127.0.0.1:11273] - WARN  [main-SendThread(127.0.0.1:11273):ClientCnxn$SendThread@1235] - Session 0x222add090c60000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:21,451 [myid:127.0.0.1:11257] - INFO  [main-SendThread(127.0.0.1:11257):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11257. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:21,451 [myid:127.0.0.1:11257] - ERROR [main-SendThread(127.0.0.1:11257):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11257
> 2016-07-28 09:30:21,451 [myid:127.0.0.1:11257] - WARN  [main-SendThread(127.0.0.1:11257):ClientCnxn$SendThread@1235] - Session 0x122adcf0ae70000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:21,671 [myid:127.0.0.1:11276] - INFO  [main-SendThread(127.0.0.1:11276):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11276. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:21,671 [myid:127.0.0.1:11276] - ERROR [main-SendThread(127.0.0.1:11276):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11276
> 2016-07-28 09:30:21,671 [myid:127.0.0.1:11276] - WARN  [main-SendThread(127.0.0.1:11276):ClientCnxn$SendThread@1235] - Session 0x322add08d0d0000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:21,991 [myid:127.0.0.1:11306] - INFO  [main-SendThread(127.0.0.1:11306):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11306. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:21,991 [myid:127.0.0.1:11306] - ERROR [main-SendThread(127.0.0.1:11306):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11306
> 2016-07-28 09:30:21,991 [myid:127.0.0.1:11306] - WARN  [main-SendThread(127.0.0.1:11306):ClientCnxn$SendThread@1235] - Session 0x222add109d00000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,091 [myid:127.0.0.1:11263] - INFO  [main-SendThread(127.0.0.1:11263):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11263. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:22,091 [myid:127.0.0.1:11263] - ERROR [main-SendThread(127.0.0.1:11263):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11263
> 2016-07-28 09:30:22,091 [myid:127.0.0.1:11263] - WARN  [main-SendThread(127.0.0.1:11263):ClientCnxn$SendThread@1235] - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,111 [myid:127.0.0.1:11303] - INFO  [main-SendThread(127.0.0.1:11303):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11303. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:22,111 [myid:127.0.0.1:11303] - ERROR [main-SendThread(127.0.0.1:11303):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11303
> 2016-07-28 09:30:22,111 [myid:127.0.0.1:11303] - WARN  [main-SendThread(127.0.0.1:11303):ClientCnxn$SendThread@1235] - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,241 [myid:127.0.0.1:11270] - INFO  [main-SendThread(127.0.0.1:11270):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11270. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:22,241 [myid:127.0.0.1:11270] - ERROR [main-SendThread(127.0.0.1:11270):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11270
> 2016-07-28 09:30:22,241 [myid:127.0.0.1:11270] - WARN  [main-SendThread(127.0.0.1:11270):ClientCnxn$SendThread@1235] - Session 0x122add08ccf0000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,341 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.3,name2=Follower]
> 2016-07-28 09:30:22,341 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1115)
> 2016-07-28 09:30:22,341 [myid:] - WARN  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):QuorumPeer@1158] - PeerState set to LOOKING
> 2016-07-28 09:30:22,341 [myid:] - WARN  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):QuorumPeer@1140] - QuorumPeer main thread exited
> 2016-07-28 09:30:22,341 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3]
> 2016-07-28 09:30:22,342 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.3]
> 2016-07-28 09:30:22,342 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.1]
> 2016-07-28 09:30:22,342 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.2]
> 2016-07-28 09:30:22,342 [myid:] - INFO  [QuorumPeer[myid=3](plain=/127.0.0.1:11377)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id3,name1=replica.5]
> 2016-07-28 09:30:22,342 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled)
> 2016-07-28 09:30:22,342 [myid:] - INFO  [main:Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.shutdown(QuorumPeer.java:1184)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdown(QuorumUtil.java:251)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdownAll(QuorumUtil.java:238)
> 	at org.apache.zookeeper.test.QuorumUtil.tearDown(QuorumUtil.java:306)
> 	at org.apache.zookeeper.test.ReconfigTest.tearDown(ReconfigTest.java:64)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
> 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:53)
> 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
> 2016-07-28 09:30:22,342 [myid:] - INFO  [main:LearnerZooKeeperServer@165] - Shutting down
> 2016-07-28 09:30:22,342 [myid:] - INFO  [main:ZooKeeperServer@498] - shutting down
> 2016-07-28 09:30:22,343 [myid:] - INFO  [main:FollowerRequestProcessor@138] - Shutting down
> 2016-07-28 09:30:22,343 [myid:] - INFO  [main:CommitProcessor@414] - Shutting down
> 2016-07-28 09:30:22,343 [myid:] - INFO  [FollowerRequestProcessor:4:FollowerRequestProcessor@109] - FollowerRequestProcessor exited loop!
> 2016-07-28 09:30:22,343 [myid:] - INFO  [CommitProcessor:4:CommitProcessor@299] - CommitProcessor exited loop!
> 2016-07-28 09:30:22,343 [myid:] - INFO  [main:FinalRequestProcessor@479] - shutdown of request processor complete
> 2016-07-28 09:30:22,344 [myid:] - INFO  [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.4,name2=Follower,name3=InMemoryDataTree]
> 2016-07-28 09:30:22,344 [myid:] - INFO  [main:SyncRequestProcessor@191] - Shutting down
> 2016-07-28 09:30:22,344 [myid:] - INFO  [SyncThread:4:SyncRequestProcessor@169] - SyncRequestProcessor exited!
> 2016-07-28 09:30:22,344 [myid:] - INFO  [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted
> 2016-07-28 09:30:22,345 [myid:] - INFO  [NIOServerCxnFactory.AcceptThread:/127.0.0.1:11380:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method
> 2016-07-28 09:30:22,345 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:22,345 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:22,346 [myid:] - INFO  [/127.0.0.1:11382:QuorumCnxManager$Listener@661] - Leaving listener
> 2016-07-28 09:30:22,346 [myid:] - INFO  [main:QuorumUtil@254] - Shutting down leader election QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled)
> 2016-07-28 09:30:22,346 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled) to exit thread
> 2016-07-28 09:30:22,521 [myid:127.0.0.1:11309] - INFO  [main-SendThread(127.0.0.1:11309):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11309. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:22,521 [myid:127.0.0.1:11309] - ERROR [main-SendThread(127.0.0.1:11309):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11309
> 2016-07-28 09:30:22,521 [myid:127.0.0.1:11309] - WARN  [main-SendThread(127.0.0.1:11309):ClientCnxn$SendThread@1235] - Session 0x322add109d50000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,631 [myid:127.0.0.1:11273] - INFO  [main-SendThread(127.0.0.1:11273):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11273. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:22,631 [myid:127.0.0.1:11273] - ERROR [main-SendThread(127.0.0.1:11273):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11273
> 2016-07-28 09:30:22,631 [myid:127.0.0.1:11273] - WARN  [main-SendThread(127.0.0.1:11273):ClientCnxn$SendThread@1235] - Session 0x222add090c60000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:22,761 [myid:] - INFO  [WorkerReceiver[myid=4]:FastLeaderElection$Messenger$WorkerReceiver@440] - WorkerReceiver is down
> 2016-07-28 09:30:22,761 [myid:] - INFO  [WorkerSender[myid=4]:FastLeaderElection$Messenger$WorkerSender@470] - WorkerSender is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerReceiver[myid=1]:FastLeaderElection$Messenger$WorkerReceiver@440] - WorkerReceiver is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerSender[myid=1]:FastLeaderElection$Messenger$WorkerSender@470] - WorkerSender is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerSender[myid=2]:FastLeaderElection$Messenger$WorkerSender@470] - WorkerSender is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@440] - WorkerReceiver is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection$Messenger$WorkerReceiver@440] - WorkerReceiver is down
> 2016-07-28 09:30:22,771 [myid:] - INFO  [WorkerSender[myid=3]:FastLeaderElection$Messenger$WorkerSender@470] - WorkerSender is down
> 2016-07-28 09:30:23,061 [myid:127.0.0.1:11260] - INFO  [main-SendThread(127.0.0.1:11260):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11260. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:23,061 [myid:127.0.0.1:11260] - ERROR [main-SendThread(127.0.0.1:11260):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11260
> 2016-07-28 09:30:23,061 [myid:127.0.0.1:11260] - WARN  [main-SendThread(127.0.0.1:11260):ClientCnxn$SendThread@1235] - Session 0x222adcf0da20000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:23,211 [myid:127.0.0.1:11263] - INFO  [main-SendThread(127.0.0.1:11263):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11263. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:23,211 [myid:127.0.0.1:11263] - ERROR [main-SendThread(127.0.0.1:11263):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11263
> 2016-07-28 09:30:23,211 [myid:127.0.0.1:11263] - WARN  [main-SendThread(127.0.0.1:11263):ClientCnxn$SendThread@1235] - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:23,231 [myid:127.0.0.1:11303] - INFO  [main-SendThread(127.0.0.1:11303):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11303. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:23,231 [myid:127.0.0.1:11276] - INFO  [main-SendThread(127.0.0.1:11276):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11276. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:23,231 [myid:127.0.0.1:11303] - ERROR [main-SendThread(127.0.0.1:11303):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11303
> 2016-07-28 09:30:23,231 [myid:127.0.0.1:11303] - WARN  [main-SendThread(127.0.0.1:11303):ClientCnxn$SendThread@1235] - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:23,231 [myid:127.0.0.1:11276] - ERROR [main-SendThread(127.0.0.1:11276):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11276
> 2016-07-28 09:30:23,232 [myid:127.0.0.1:11276] - WARN  [main-SendThread(127.0.0.1:11276):ClientCnxn$SendThread@1235] - Session 0x322add08d0d0000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:23,341 [myid:127.0.0.1:11257] - INFO  [main-SendThread(127.0.0.1:11257):ClientCnxn$SendThread@1113] - Opening socket connection to server 127.0.0.1/127.0.0.1:11257. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-28 09:30:23,341 [myid:127.0.0.1:11257] - ERROR [main-SendThread(127.0.0.1:11257):ClientCnxnSocketNIO@287] - Unable to open socket to 127.0.0.1/127.0.0.1:11257
> 2016-07-28 09:30:23,341 [myid:127.0.0.1:11257] - WARN  [main-SendThread(127.0.0.1:11257):ClientCnxn$SendThread@1235] - Session 0x122adcf0ae70000 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.Net.connect0(Native Method)
> 	at sun.nio.ch.Net.connect(Net.java:465)
> 	at sun.nio.ch.Net.connect(Net.java:457)
> 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:275)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:285)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1098)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1133)
> 2016-07-28 09:30:23,351 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.4,name2=Follower]
> 2016-07-28 09:30:23,351 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):Follower@198] - shutdown called
> java.lang.Exception: shutdown Follower
> 	at org.apache.zookeeper.server.quorum.Follower.shutdown(Follower.java:198)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1115)
> 2016-07-28 09:30:23,351 [myid:] - WARN  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):QuorumPeer@1158] - PeerState set to LOOKING
> 2016-07-28 09:30:23,351 [myid:] - WARN  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):QuorumPeer@1140] - QuorumPeer main thread exited
> 2016-07-28 09:30:23,351 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.4]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.1]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.2]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.3]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [QuorumPeer[myid=4](plain=/127.0.0.1:11380)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id4,name1=replica.5]
> 2016-07-28 09:30:23,352 [myid:] - INFO  [main:QuorumUtil@250] - Shutting down quorum peer QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled)
> 2016-07-28 09:30:23,352 [myid:] - INFO  [main:Leader@617] - Shutting down
> 2016-07-28 09:30:23,352 [myid:] - INFO  [main:Leader@623] - Shutdown called
> java.lang.Exception: shutdown Leader! reason: quorum Peer shutdown
> 	at org.apache.zookeeper.server.quorum.Leader.shutdown(Leader.java:623)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.shutdown(QuorumPeer.java:1181)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdown(QuorumUtil.java:251)
> 	at org.apache.zookeeper.test.QuorumUtil.shutdownAll(QuorumUtil.java:238)
> 	at org.apache.zookeeper.test.QuorumUtil.tearDown(QuorumUtil.java:306)
> 	at org.apache.zookeeper.test.ReconfigTest.tearDown(ReconfigTest.java:64)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
> 	at org.junit.rules.TestWatchman$1.evaluate(TestWatchman.java:53)
> 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
> 2016-07-28 09:30:23,353 [myid:] - INFO  [main:ZooKeeperServer@498] - shutting down
> 2016-07-28 09:30:23,353 [myid:] - INFO  [main:SessionTrackerImpl@232] - Shutting down
> 2016-07-28 09:30:23,353 [myid:] - INFO  [main:LeaderRequestProcessor@77] - Shutting down
> 2016-07-28 09:30:23,353 [myid:] - INFO  [main:PrepRequestProcessor@965] - Shutting down
> 2016-07-28 09:30:23,353 [myid:] - INFO  [LearnerCnxAcceptor-/127.0.0.1:11384:Leader$LearnerCnxAcceptor@373] - exception while shutting down acceptor: java.net.SocketException: Socket closed
> 2016-07-28 09:30:23,353 [myid:] - INFO  [ProcessThread(sid:5 cport:-1)::PrepRequestProcessor@154] - PrepRequestProcessor exited loop!
> 2016-07-28 09:30:23,353 [myid:] - INFO  [main:ProposalRequestProcessor@88] - Shutting down
> 2016-07-28 09:30:23,354 [myid:] - INFO  [main:CommitProcessor@414] - Shutting down
> 2016-07-28 09:30:23,354 [myid:] - INFO  [CommitProcessor:5:CommitProcessor@299] - CommitProcessor exited loop!
> 2016-07-28 09:30:23,354 [myid:] - INFO  [main:Leader$ToBeAppliedRequestProcessor@918] - Shutting down
> 2016-07-28 09:30:23,354 [myid:] - INFO  [main:FinalRequestProcessor@479] - shutdown of request processor complete
> 2016-07-28 09:30:23,354 [myid:] - INFO  [main:SyncRequestProcessor@191] - Shutting down
> 2016-07-28 09:30:23,354 [myid:] - INFO  [SyncThread:5:SyncRequestProcessor@169] - SyncRequestProcessor exited!
> 2016-07-28 09:30:23,355 [myid:] - INFO  [main:MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.5,name2=Leader,name3=InMemoryDataTree]
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51992:LearnerHandler@619] - ******* GOODBYE /127.0.0.1:51992 ********
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51977:LearnerHandler@619] - ******* GOODBYE /127.0.0.1:51977 ********
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51992:LearnerHandler@903] - Ignoring unexpected exception
> java.lang.InterruptedException
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219)
> 	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340)
> 	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.shutdown(LearnerHandler.java:901)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:622)
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51976:LearnerHandler@619] - ******* GOODBYE /127.0.0.1:51976 ********
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51975:LearnerHandler@619] - ******* GOODBYE /127.0.0.1:51975 ********
> 2016-07-28 09:30:23,356 [myid:] - INFO  [ConnnectionExpirer:NIOServerCnxnFactory$ConnectionExpirerThread@583] - ConnnectionExpirerThread interrupted
> 2016-07-28 09:30:23,356 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-0:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:23,355 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51977:LearnerHandler@903] - Ignoring unexpected exception
> java.lang.InterruptedException
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219)
> 	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340)
> 	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.shutdown(LearnerHandler.java:901)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:622)
> 2016-07-28 09:30:23,356 [myid:] - INFO  [NIOServerCxnFactory.AcceptThread:/127.0.0.1:11383:NIOServerCnxnFactory$AcceptThread@219] - accept thread exitted run method
> 2016-07-28 09:30:23,356 [myid:] - INFO  [NIOServerCxnFactory.SelectorThread-1:NIOServerCnxnFactory$SelectorThread@420] - selector thread exitted run method
> 2016-07-28 09:30:23,356 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51975:LearnerHandler@903] - Ignoring unexpected exception
> java.lang.InterruptedException
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219)
> 	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340)
> 	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.shutdown(LearnerHandler.java:901)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:622)
> 2016-07-28 09:30:23,356 [myid:] - WARN  [LearnerHandler-/127.0.0.1:51976:LearnerHandler@903] - Ignoring unexpected exception
> java.lang.InterruptedException
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219)
> 	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340)
> 	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:338)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.shutdown(LearnerHandler.java:901)
> 	at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:622)
> 2016-07-28 09:30:23,357 [myid:] - INFO  [/127.0.0.1:11385:QuorumCnxManager$Listener@661] - Leaving listener
> 2016-07-28 09:30:23,357 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.5,name2=Leader]
> 2016-07-28 09:30:23,358 [myid:] - INFO  [main:QuorumUtil@254] - Shutting down leader election QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled)
> 2016-07-28 09:30:23,358 [myid:] - WARN  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):QuorumPeer@1127] - Unexpected exception
> java.lang.InterruptedException
> 	at java.lang.Object.wait(Native Method)
> 	at org.apache.zookeeper.server.quorum.Leader.lead(Leader.java:561)
> 	at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1124)
> 2016-07-28 09:30:23,358 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):Leader@617] - Shutting down
> 2016-07-28 09:30:23,358 [myid:] - WARN  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):QuorumPeer@1158] - PeerState set to LOOKING
> 2016-07-28 09:30:23,358 [myid:] - WARN  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):QuorumPeer@1140] - QuorumPeer main thread exited
> 2016-07-28 09:30:23,358 [myid:] - INFO  [main:QuorumUtil@259] - Waiting for QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled) to exit thread
> 2016-07-28 09:30:23,358 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5]
> 2016-07-28 09:30:23,359 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.5]
> 2016-07-28 09:30:23,359 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.1]
> 2016-07-28 09:30:23,359 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.2]
> 2016-07-28 09:30:23,359 [myid:] - INFO  [QuorumPeer[myid=5](plain=/127.0.0.1:11383)(secure=disabled):MBeanRegistry@128] - Unregister MBean [org.apache.ZooKeeperService:name0=ReplicatedServer_id5,name1=replica.3]
> 2016-07-28 09:30:23,359 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11371
> 2016-07-28 09:30:23,359 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11371 is no longer accepting client connections
> 2016-07-28 09:30:23,359 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11374
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11374 is no longer accepting client connections
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11377
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11377 is no longer accepting client connections
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11380
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11380 is no longer accepting client connections
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:FourLetterWordMain@85] - connecting to 127.0.0.1 11383
> 2016-07-28 09:30:23,360 [myid:] - INFO  [main:QuorumUtil@243] - 127.0.0.1:11383 is no longer accepting client connections
> 2016-07-28 09:30:23,361 [myid:] - INFO  [main:ZKTestCase$1@65] - SUCCEEDED testRemoveOneAsynchronous
> 2016-07-28 09:30:23,361 [myid:] - INFO  [main:ZKTestCase$1@60] - FINISHED testRemoveOneAsynchronous
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)