You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/04/01 01:21:23 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_60-ea-b10) -
Build # 9957 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9957/
Java: 32bit/jdk1.7.0_60-ea-b10 -server -XX:+UseG1GC
1 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([DA1E3EABEEE038BD:DE16B158FC45D79C]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:156)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:289)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:156)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:667)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
... 45 more
Build Log:
[...truncated 10864 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-OverseerTest-1396307069123
[junit4] 2> 447725 T2259 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 447725 T2259 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 447726 T2259 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 447729 T2259 oas.SolrTestCaseJ4.setUp ###Starting testStateChange
[junit4] 2> 447729 T2259 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 447730 T2260 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 447830 T2259 oasc.ZkTestServer.run start zk server on port:53289
[junit4] 2> 447831 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 454531 T2263 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 6698ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 454533 T2266 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1113a9c name:ZooKeeperConnection Watcher:127.0.0.1:53289/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 454534 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 454535 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 454538 T2268 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d0cc4a name:ZooKeeperConnection Watcher:127.0.0.1:53289 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 454538 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 454542 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 454544 T2270 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b4e178 name:ZooKeeperConnection Watcher:127.0.0.1:53289 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 454544 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 454545 T2259 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 454547 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 454548 T2259 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 454550 T2259 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 454552 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 454553 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 454554 T2272 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d6ed8d name:ZooKeeperConnection Watcher:127.0.0.1:53289/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 454554 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 454555 T2259 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 454556 T2259 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 454559 T2259 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:53289_solr
[junit4] 2> 454559 T2259 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 454560 T2259 oasc.Overseer.start Overseer (id=91508380082569219-127.0.0.1:53289_solr-n_0000000000) starting
[junit4] 2> 454562 T2259 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 454564 T2259 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 454566 T2259 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 454567 T2259 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 454569 T2259 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 454571 T2259 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 454574 T2274 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 454575 T2274 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 454575 T2273 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 454576 T2259 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 454577 T2273 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 454577 T2273 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 454577 T2273 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 454579 T2272 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 454579 T2266 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 454627 T2259 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 454631 T2272 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 454633 T2273 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 454633 T2273 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"active"}
[junit4] 2> 454634 T2273 oasc.Overseer$ClusterStateUpdater.updateState node=core_node1 is already registered
[junit4] 2> 454634 T2273 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 454637 T2272 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 454740 T2266 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 454783 T2259 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53289 53289
[junit4] 2> 455003 T2260 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53289 53289
[junit4] 2> 455004 T2259 oas.SolrTestCaseJ4.tearDown ###Ending testStateChange
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 455008 T2259 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4] 2> 455009 T2259 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 455009 T2275 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 455109 T2259 oasc.ZkTestServer.run start zk server on port:56163
[junit4] 2> 455110 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455113 T2281 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a7507b name:ZooKeeperConnection Watcher:127.0.0.1:56163 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455113 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455122 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455123 T2283 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e02b34 name:ZooKeeperConnection Watcher:127.0.0.1:56163 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455123 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455123 T2259 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 455125 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455126 T2285 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1838e99 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455126 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455126 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 455128 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455129 T2287 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@162882f name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455129 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455130 T2259 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 455132 T2259 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 455135 T2259 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:56163_solr
[junit4] 2> 455136 T2259 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 455137 T2259 oasc.Overseer.start Overseer (id=91508380559671299-127.0.0.1:56163_solr-n_0000000000) starting
[junit4] 2> 455140 T2259 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 455144 T2259 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 455147 T2259 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 455149 T2259 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 455151 T2259 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 455154 T2259 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 455157 T2289 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 455158 T2259 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 455158 T2288 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 455158 T2289 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 455159 T2259 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 455162 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455166 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455168 T2291 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ada97d name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455168 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455169 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455171 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4] 2> 455173 T2291 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 455173 T2285 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 455174 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455175 T2293 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@552fe7 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455175 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455176 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455178 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 455180 T2285 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 455180 T2291 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 455180 T2293 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 455181 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455182 T2295 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a408a9 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455182 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455183 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455185 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 455187 T2291 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 455187 T2285 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 455187 T2293 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 455187 T2295 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 455188 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455189 T2297 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15770ee name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455189 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455190 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455191 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4] 2> 455193 T2293 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 455193 T2285 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 455193 T2291 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 455194 T2295 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 455194 T2297 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 455194 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455195 T2299 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fe5f5c name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455195 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455196 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455197 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4] 2> 455199 T2295 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 455199 T2285 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 455199 T2293 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 455199 T2297 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 455199 T2291 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 455199 T2299 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 455200 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455201 T2301 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b22c45 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455201 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455202 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455203 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4] 2> 455204 T2291 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 455205 T2295 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 455205 T2299 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 455205 T2285 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 455205 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455205 T2293 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 455205 T2297 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 455205 T2301 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 455207 T2303 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@411ef4 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455207 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455208 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455209 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4] 2> 455211 T2295 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 455211 T2291 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 455211 T2285 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 455211 T2303 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 455212 T2299 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 455212 T2293 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 455211 T2297 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 455211 T2301 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 455212 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455213 T2305 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@142bd51 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455213 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455214 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455216 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4] 2> 455218 T2291 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 455218 T2303 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 455218 T2305 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 455218 T2295 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 455219 T2293 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 455219 T2299 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 455218 T2297 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 455218 T2285 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 455219 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455219 T2301 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 455221 T2307 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ddc626 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455222 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455223 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455225 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4] 2> 455228 T2305 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 455228 T2303 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 455229 T2299 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 455228 T2297 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 455228 T2301 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 455228 T2291 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 455228 T2307 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 455228 T2295 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 455229 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455229 T2285 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 455230 T2309 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e9c214 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455229 T2293 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 455230 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455232 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455233 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4] 2> 455235 T2291 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 455235 T2297 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 455235 T2309 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 455236 T2285 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 455236 T2303 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 455235 T2295 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 455235 T2299 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 455236 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455236 T2307 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 455236 T2293 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 455236 T2301 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 455236 T2305 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 455237 T2311 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@118ae8e name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455237 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455238 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455240 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4] 2> 455241 T2307 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455242 T2297 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455242 T2295 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455242 T2291 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455242 T2303 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455242 T2305 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455242 T2309 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455242 T2285 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455242 T2293 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455242 T2301 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455242 T2299 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455243 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455244 T2313 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c25c6 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455242 T2311 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 455244 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455245 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455246 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4] 2> 455248 T2295 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455248 T2303 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455248 T2297 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455249 T2285 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455248 T2309 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455248 T2305 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455249 T2313 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455249 T2311 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455248 T2299 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455248 T2301 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455248 T2307 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455248 T2291 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455248 T2293 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 455250 T2315 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19f1ef5 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455249 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455251 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455251 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455253 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4] 2> 455255 T2293 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455255 T2285 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455255 T2307 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455255 T2303 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455256 T2313 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455256 T2315 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455256 T2309 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455256 T2291 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455255 T2305 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455255 T2299 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455255 T2297 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455255 T2295 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455255 T2301 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455257 T2317 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16163b9 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455256 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455256 T2311 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 455258 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455260 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455263 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4] 2> 455266 T2305 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455266 T2295 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455267 T2293 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455267 T2303 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455267 T2285 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455267 T2307 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455267 T2299 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455267 T2311 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455268 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455269 T2297 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455269 T2301 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455269 T2313 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455269 T2319 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b7f5a name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455270 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455270 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455272 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4] 2> 455267 T2309 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455267 T2315 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455269 T2291 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455268 T2317 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 455274 T2305 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455274 T2299 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455274 T2309 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455274 T2315 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455275 T2313 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455275 T2311 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455274 T2303 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455274 T2301 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455274 T2319 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455274 T2297 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455275 T2295 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455275 T2307 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455275 T2317 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455275 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455274 T2291 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455274 T2293 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455274 T2285 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 455276 T2321 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f2c8f name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455277 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455278 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455280 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4] 2> 455282 T2303 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455282 T2297 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455282 T2315 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455283 T2301 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455283 T2295 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455283 T2309 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455283 T2311 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455283 T2319 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455282 T2285 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455282 T2307 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455282 T2291 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455282 T2299 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455283 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455283 T2321 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455283 T2317 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455283 T2293 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455283 T2313 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455283 T2305 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 455284 T2323 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11b8cd name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455285 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455286 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455288 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4] 2> 455290 T2301 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455290 T2305 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455290 T2319 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455290 T2299 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455291 T2293 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455291 T2285 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455291 T2315 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455290 T2321 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455290 T2291 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455290 T2295 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455290 T2297 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455291 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455291 T2323 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455291 T2317 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455291 T2309 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455291 T2311 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455290 T2303 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455290 T2307 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455290 T2313 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 455293 T2325 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@133743b name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455293 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455294 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455296 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4] 2> 455298 T2313 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455298 T2293 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2303 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2323 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2305 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2295 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2301 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455298 T2285 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2315 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2325 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455299 T2319 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2317 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2297 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2321 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2291 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2307 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2299 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2311 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455299 T2309 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 455300 T2327 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1385dab name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455302 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455303 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455305 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4] 2> 455308 T2293 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455308 T2299 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455309 T2307 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455309 T2321 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455309 T2317 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455309 T2305 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455309 T2327 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455308 T2303 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455308 T2325 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455308 T2311 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455308 T2313 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455308 T2285 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455308 T2315 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455310 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455309 T2291 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455309 T2295 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455309 T2319 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455309 T2301 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455309 T2297 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455309 T2323 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455309 T2309 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 455312 T2329 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14e220b name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455314 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455316 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455320 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4] 2> 455323 T2299 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455324 T2313 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455324 T2307 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455325 T2315 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455325 T2285 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455325 T2317 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455325 T2321 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455325 T2323 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455326 T2291 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455325 T2293 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455327 T2309 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455326 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455326 T2319 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455326 T2327 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455326 T2297 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455326 T2329 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455326 T2305 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455326 T2295 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455326 T2303 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455326 T2325 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455325 T2311 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455325 T2301 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 455328 T2331 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13e3522 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455330 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455332 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455335 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4] 2> 455338 T2299 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455338 T2293 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2303 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2307 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2315 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2285 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2325 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2309 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455340 T2327 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2311 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2321 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2297 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2291 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2313 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2329 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2305 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2317 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2331 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455339 T2295 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455341 T2333 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ee4e03 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455340 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455340 T2323 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455340 T2301 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455340 T2319 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 455342 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455343 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455345 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4] 2> 455350 T2285 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455350 T2313 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455350 T2293 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2299 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2317 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2291 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2297 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2301 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455350 T2307 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455350 T2315 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455352 T2323 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455350 T2325 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455352 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455352 T2311 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455352 T2303 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455352 T2309 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2327 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2331 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2333 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2321 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2329 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2305 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2295 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455351 T2319 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 455353 T2335 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b7d5ea name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455355 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455356 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455358 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
[junit4] 2> 455360 T2291 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455360 T2305 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455360 T2299 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455360 T2325 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2313 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2303 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455360 T2329 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2311 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2309 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2323 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2327 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2333 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2315 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2319 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455360 T2285 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455360 T2295 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455360 T2321 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455360 T2297 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455360 T2317 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455363 T2337 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12be4a7 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455362 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455362 T2335 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455362 T2293 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2331 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2307 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455361 T2301 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 455364 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455365 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455367 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
[junit4] 2> 455369 T2293 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455370 T2299 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455370 T2313 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455370 T2305 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455370 T2321 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455370 T2311 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455370 T2327 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2285 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2323 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2295 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2337 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2317 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455372 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455372 T2333 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455372 T2291 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455372 T2309 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455372 T2335 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455372 T2303 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2307 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2331 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2315 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2325 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2329 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2297 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2319 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455371 T2301 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 455373 T2339 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1283ef1 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455376 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455376 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455378 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
[junit4] 2> 455380 T2329 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455380 T2319 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455381 T2305 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455381 T2291 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455381 T2335 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455380 T2295 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455381 T2297 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455381 T2303 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455382 T2309 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455382 T2293 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455382 T2315 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455381 T2301 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455381 T2337 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455381 T2317 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455381 T2327 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455381 T2339 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455381 T2321 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455383 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455382 T2333 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455382 T2299 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455382 T2323 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455382 T2325 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455382 T2307 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455382 T2285 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455384 T2341 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@328446 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455382 T2313 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455382 T2311 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455382 T2331 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 455384 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455386 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455387 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
[junit4] 2> 455389 T2329 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455389 T2295 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2327 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2305 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2321 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2311 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2317 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2293 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2303 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455391 T2325 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2339 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2319 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2341 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2297 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2291 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2301 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455391 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455391 T2335 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455391 T2309 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455391 T2323 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455391 T2333 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455391 T2307 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455391 T2299 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2315 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2313 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2337 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2331 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455390 T2285 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 455392 T2343 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ead8d name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455394 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455395 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455396 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
[junit4] 2> 455399 T2335 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455399 T2305 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455399 T2309 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2331 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2299 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455399 T2319 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2307 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2291 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2293 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455401 T2327 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455401 T2333 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2295 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2337 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2339 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2311 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2329 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455399 T2321 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455401 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455401 T2341 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455402 T2345 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a8bb29 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455401 T2285 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455401 T2323 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455401 T2303 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455401 T2301 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455401 T2343 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455401 T2315 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455401 T2325 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2317 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2297 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455400 T2313 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 455403 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455405 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455407 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
[junit4] 2> 455409 T2293 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455409 T2311 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2329 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2299 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2339 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2315 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2335 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2331 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2307 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455411 T2327 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455411 T2291 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455411 T2323 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455411 T2333 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455411 T2325 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455411 T2295 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2285 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2321 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2343 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2303 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2341 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2337 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2319 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2309 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2305 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455410 T2313 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455413 T2347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@198e6aa name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455412 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455411 T2345 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455411 T2301 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455411 T2297 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455411 T2317 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 455415 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455416 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455419 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
[junit4] 2> 455421 T2333 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455421 T2285 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455421 T2291 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455422 T2315 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455421 T2303 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455423 T2299 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455423 T2319 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455421 T2343 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455424 T2307 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455421 T2325 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455424 T2293 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455424 T2347 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455424 T2337 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455424 T2323 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455424 T2339 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455424 T2341 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455423 T2321 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455423 T2301 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455423 T2335 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455423 T2327 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455423 T2331 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455423 T2313 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455422 T2329 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455422 T2305 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455422 T2309 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455422 T2345 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455422 T2295 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455421 T2317 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455421 T2297 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455421 T2311 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 455426 T2349 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d10c91 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455424 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455428 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455429 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455431 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
[junit4] 2> 455435 T2325 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2315 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2333 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2323 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2327 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2343 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2317 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2285 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2309 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2313 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2345 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2321 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2299 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2349 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2307 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2295 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2297 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2291 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2303 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455436 T2301 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455438 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455438 T2347 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455438 T2329 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455438 T2339 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455438 T2305 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2335 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2341 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2293 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2319 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2311 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2337 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455437 T2331 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 455439 T2351 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a5303 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455442 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455443 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455445 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node30
[junit4] 2> 455448 T2285 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455448 T2323 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455448 T2327 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455448 T2301 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2297 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2313 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2307 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455448 T2333 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455448 T2315 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2311 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455450 T2321 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2339 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455450 T2335 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2331 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2349 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2293 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2351 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2299 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2309 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2295 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2291 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2343 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2345 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455448 T2317 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455448 T2325 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455448 T2303 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455451 T2353 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aa814b name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455450 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455450 T2347 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455450 T2305 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455450 T2319 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455450 T2337 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455450 T2329 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455449 T2341 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 455453 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455454 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455456 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node31
[junit4] 2> 455458 T2337 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455459 T2335 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455459 T2331 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455459 T2307 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455459 T2329 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455460 T2343 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455460 T2295 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455459 T2293 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455459 T2311 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455460 T2339 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455460 T2323 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455460 T2305 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455460 T2341 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2353 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455459 T2313 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455459 T2303 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455459 T2309 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455462 T2259 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455461 T2347 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2333 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2351 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2327 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2299 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2321 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2319 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2345 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2297 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2301 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2315 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2317 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2291 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2349 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455461 T2285 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455460 T2325 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 455463 T2355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ee9921 name:ZooKeeperConnection Watcher:127.0.0.1:56163/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455465 T2259 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455466 T2259 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 455468 T2259 oascc.SolrZkClient.makePath makePath: /live_nodes/node32
[junit4] 2> 455471 T2335 o
[...truncated too long message...]
olrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 492890 T2706 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 492891 T2704 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 492893 T2708 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 492894 T2709 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 492895 T2708 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 492997 T2706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 493091 T2259 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 493145 T2706 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 493146 T2259 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:40360 40360
[junit4] 2> 493227 T2591 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:40360 40360
[junit4] 2> 493228 T2259 oas.SolrTestCaseJ4.tearDown ###Ending testShardLeaderChange
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 493230 T2259 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 493230 T2259 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 493719 T2690 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 493946 T2696 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 493947 T2696 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 496230 T2259 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=489), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=489)), sim=DefaultSimilarity, locale=ca, timezone=Europe/Malta
[junit4] 2> NOTE: Linux 3.8.0-37-generic i386/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=8,threads=1,free=230065904,total=510656512
[junit4] 2> NOTE: All tests run in this JVM: [TestSimpleQParserPlugin, CircularListTest, EnumFieldTest, DistributedTermsComponentTest, EchoParamsTest, TestNonDefinedSimilarityFactory, IndexSchemaTest, TestRecoveryHdfs, FieldFacetExtrasTest, TestGroupingSearch, SliceStateTest, LeaderElectionTest, PrimitiveFieldTypeTest, TestTrie, AutoCommitTest, TestRequestStatusCollectionAPI, SSLMigrationTest, TestRandomMergePolicy, AnalysisErrorHandlingTest, TestFieldCollectionResource, CursorPagingTest, SimpleFacetsTest, DistributedQueryElevationComponentTest, SolrCoreTest, SliceStateUpdateTest, TestSystemIdResolver, TestCloudManagedSchema, TestSerializedLuceneMatchVersion, ExternalFileFieldSortTest, TestClassNameShortening, TestSolrDeletionPolicy1, LoggingHandlerTest, QueryFacetTest, TestExtendedDismaxParser, LegacyHTMLStripCharFilterTest, DocumentBuilderTest, FastVectorHighlighterTest, AssignTest, ShowFileRequestHandlerTest, DateMathParserTest, TestStressUserVersions, FieldMutatingUpdateProcessorTest, SolrInfoMBeanTest, TestLRUCache, DistributedSpellCheckComponentTest, TestFieldResource, TestRestManager, TestElisionMultitermQuery, ModifyConfFileTest, TestBadConfig, HdfsWriteToMultipleCollectionsTest, SoftAutoCommitTest, TestLuceneMatchVersion, TestFaceting, TestFieldSortValues, HdfsLockFactoryTest, TestCollapseQParserPlugin, AnalysisAfterCoreReloadTest, SynonymTokenizerTest, TestLMJelinekMercerSimilarityFactory, TermVectorComponentTest, TestPHPSerializedResponseWriter, TestSolrXmlPersistence, TestRealTimeGet, TestDocumentBuilder, URLClassifyProcessorTest, ZkControllerTest, TestValueSourceCache, UnloadDistributedZkTest, BasicDistributedZkTest, OverseerTest]
[junit4] Completed on J0 in 48.54s, 9 tests, 1 error <<< FAILURES!
[...truncated 903 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 394 suites, 1653 tests, 1 error, 49 ignored (28 assumptions)
Total time: 57 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60-ea-b10 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure