You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/07/08 14:02:28 UTC
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_60) - Build #
4082 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/4082/
Java: 32bit/jdk1.7.0_60 -client -XX:+UseSerialGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch
Error Message:
Mutual exclusion failed. Found more than one task running for the same collection
Stack Trace:
java.lang.AssertionError: Mutual exclusion failed. Found more than one task running for the same collection
at __randomizedtesting.SeedInfo.seed([BEA7FD33D4D11B71:3F41732BA38E7B4D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:129)
at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:70)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([BEA7FD33D4D11B71:BAAF72C0C674F450]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:143)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:660)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:130)
... 49 more
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:135)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
... 50 more
Build Log:
[...truncated 11086 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.OverseerTest-BEA7FD33D4D11B71-001\init-core-data-001
[junit4] 2> 798932 T1963 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 798932 T1963 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 798932 T1963 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 798937 T1963 oas.SolrTestCaseJ4.setUp ###Starting testReplay
[junit4] 2> 798938 T1963 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 798939 T1964 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 799005 T1963 oasc.ZkTestServer.run start zk server on port:59264
[junit4] 2> 799007 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799010 T1970 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18b1557 name:ZooKeeperConnection Watcher:127.0.0.1:59264/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799010 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799011 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799012 T1972 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@134826b name:ZooKeeperConnection Watcher:127.0.0.1:59264 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799012 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799016 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799017 T1974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15db5e9 name:ZooKeeperConnection Watcher:127.0.0.1:59264 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799017 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799017 T1963 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 799020 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 799023 T1963 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 799025 T1963 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 799027 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 799032 T1963 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 799037 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799038 T1976 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c2d801 name:ZooKeeperConnection Watcher:127.0.0.1:59264/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799038 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799039 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 799042 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 799046 T1963 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:59264_solr
[junit4] 2> 799046 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 799048 T1963 oasc.Overseer.start Overseer (id=92066086642778115-127.0.0.1:59264_solr-n_0000000000) starting
[junit4] 2> 799051 T1963 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 799057 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 799060 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 799064 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 799068 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 799075 T1978 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 799077 T1977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 799077 T1977 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 799078 T1977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 799079 T1970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 799083 T1977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core2",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 799084 T1970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 799087 T1977 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 799090 T1977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 799091 T1977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core3",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 799095 T1976 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 799164 T1970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 799212 T1963 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:59264 59264
[junit4] 2> 800479 T1978 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 800809 T1964 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:59264 59264
[junit4] 2> 800810 T1963 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4] 2> 800811 T1977 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:59264_solr
[junit4] 2> 800812 T1979 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:316)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:288)
[junit4] 2>
[junit4] 2> 800818 T1963 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4] 2> 800820 T1963 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 800821 T1980 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 800894 T1963 oasc.ZkTestServer.run start zk server on port:59279
[junit4] 2> 800895 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800899 T1986 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@199bf18 name:ZooKeeperConnection Watcher:127.0.0.1:59279 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800899 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800903 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800905 T1988 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b84191 name:ZooKeeperConnection Watcher:127.0.0.1:59279 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800906 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800906 T1963 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 800913 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800913 T1990 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16703e8 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800914 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800914 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 800919 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800920 T1992 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9c1b0 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800920 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800922 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 800925 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 800930 T1963 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:59279_solr
[junit4] 2> 800930 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 800933 T1963 oasc.Overseer.start Overseer (id=92066086766182403-127.0.0.1:59279_solr-n_0000000000) starting
[junit4] 2> 800936 T1963 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 800940 T1963 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 800945 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 800949 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 800954 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 800960 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 800969 T1994 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 800969 T1963 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 800971 T1993 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 800972 T1963 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 800974 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 800980 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800981 T1996 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cbc1c name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800981 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800983 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 800986 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4] 2> 800991 T1996 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 800991 T1990 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 800992 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800993 T1998 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c6851b name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800993 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800995 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 800998 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 801001 T1998 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 801001 T1996 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 801001 T1990 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 801003 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801003 T2000 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a846d2 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801004 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801005 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801008 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 801011 T1996 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 801011 T1998 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 801011 T1990 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 801012 T2000 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 801012 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801014 T2002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75debf name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801015 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801016 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801019 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4] 2> 801022 T2000 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 801022 T1996 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 801022 T1990 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 801023 T1998 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 801023 T2002 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 801023 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801025 T2004 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a9fe88 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801025 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801027 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801030 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4] 2> 801034 T2004 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801034 T1996 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801034 T1990 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801034 T1998 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801034 T2000 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801034 T2002 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801036 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801038 T2006 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@702ff4 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801038 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801040 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801043 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4] 2> 801047 T1990 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801047 T1996 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801047 T2004 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801047 T2006 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801048 T2002 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801049 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801049 T2000 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801049 T1998 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801051 T2008 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f7b085 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801051 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801052 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801055 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4] 2> 801059 T2002 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801059 T2008 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801060 T2006 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801060 T1996 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801060 T2004 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801061 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801061 T1998 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801061 T1990 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801061 T2000 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801063 T2010 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ffa0f name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801064 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801066 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801069 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4] 2> 801075 T1998 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801075 T2006 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801075 T1996 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T2010 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T2000 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T2004 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T1990 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T2002 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T2008 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801077 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801078 T2012 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d7fb2e name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801079 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801082 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801086 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4] 2> 801091 T2000 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801091 T2008 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801092 T2002 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801092 T2010 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801092 T1996 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T2004 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T2006 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T2012 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T1990 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T1998 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801098 T2014 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e9e79 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801098 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801100 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801102 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4] 2> 801106 T1990 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2008 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2000 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2012 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2006 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T1998 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2010 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T1996 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2004 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2002 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2014 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801111 T2016 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b33f6c name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801109 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801112 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801115 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801119 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4] 2> 801126 T1990 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801127 T2014 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801127 T2016 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801127 T2000 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801127 T2002 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801127 T2004 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801128 T1998 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801128 T2006 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801128 T2012 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801129 T2008 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801129 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801129 T2010 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801129 T1996 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801131 T2018 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15387cb name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801131 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801133 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801136 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4] 2> 801142 T2012 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801142 T2006 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T1998 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T2010 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801144 T2014 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801144 T2000 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801144 T2004 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801144 T1990 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801144 T2016 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801145 T2020 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1494991 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801144 T2018 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T2002 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T2008 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T1996 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801145 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801148 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801153 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4] 2> 801159 T2016 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801160 T2018 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801160 T1990 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801161 T2004 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801161 T2008 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801161 T2002 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801162 T1996 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801162 T2010 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801162 T2020 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801163 T2006 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801163 T1998 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801163 T2012 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801163 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801163 T2000 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801163 T2014 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801165 T2022 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fe19db name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801165 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801166 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801169 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4] 2> 801173 T2000 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801175 T2004 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801176 T2018 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801177 T2020 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801177 T2012 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801178 T1998 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801178 T2010 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801178 T2022 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801178 T1996 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801178 T2002 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801179 T1990 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801179 T2006 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801179 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801179 T2014 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801179 T2016 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801179 T2008 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801180 T2024 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2435a9 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801180 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801182 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801187 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4] 2> 801194 T2006 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801195 T1996 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801195 T2010 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801195 T2024 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801196 T2002 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801196 T2000 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801196 T2022 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801196 T2020 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T2012 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801197 T1990 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T2016 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T2008 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T2004 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T2018 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801199 T2026 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d24e1 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801197 T2014 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T1998 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801199 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801202 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801204 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4] 2> 801210 T2010 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2024 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2012 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2008 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2020 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801212 T1990 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T1998 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2022 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2002 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801210 T1996 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801212 T2006 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801213 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801213 T2014 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801214 T2000 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801214 T2026 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801214 T2016 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801214 T2018 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801214 T2004 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801216 T2028 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@683ad name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801216 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801218 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801220 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4] 2> 801225 T2002 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T1990 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T1998 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T2006 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T2008 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T2022 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T2000 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T2014 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801227 T2004 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801227 T2012 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801227 T2020 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801227 T2010 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801228 T1996 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801228 T2024 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801229 T2028 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801229 T2016 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801229 T2026 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801229 T2018 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801231 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801233 T2030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d80815 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801233 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801236 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801238 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4] 2> 801248 T1990 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801248 T2028 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801249 T2022 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801249 T1996 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801250 T2002 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801250 T2024 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801250 T2012 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801250 T1998 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801251 T2020 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801252 T2010 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2030 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2008 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2006 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2026 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2004 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2014 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801254 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801254 T2018 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801254 T2016 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801254 T2000 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801258 T2032 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@117cdff name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801258 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801259 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801262 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4] 2> 801267 T2004 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801268 T2016 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801269 T2018 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801269 T2008 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2024 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2006 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2000 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2022 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2026 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2010 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801271 T1996 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801271 T2002 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801271 T2032 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801271 T2014 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801271 T2030 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801272 T2028 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801272 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801271 T1990 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801272 T2020 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801272 T2012 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801272 T1998 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801274 T2034 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@168f1b9 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801274 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801276 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801280 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4] 2> 801284 T2034 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801287 T2028 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801287 T1990 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801287 T2018 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801287 T2012 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801288 T2014 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801288 T2024 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801288 T2022 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T1998 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2010 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2032 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2000 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2008 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2016 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2026 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801290 T2020 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801290 T2030 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801291 T1996 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801291 T2002 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801291 T2006 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801292 T2004 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801292 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801294 T2036 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e382d8 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801294 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801295 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801298 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4] 2> 801304 T2010 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801304 T1990 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801305 T2008 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801305 T2028 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2012 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2002 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2022 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2006 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2030 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2036 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2024 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T1996 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T2020 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801307 T2004 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T2000 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801308 T2014 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801308 T2016 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T2018 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T1998 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T2034 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801309 T2038 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b156c4 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801307 T2032 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801308 T2026 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801309 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801311 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801314 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4] 2> 801320 T2020 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801320 T1990 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801321 T2010 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801322 T2028 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801322 T2032 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801322 T2012 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801322 T2002 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801322 T2006 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2038 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2034 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2018 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2024 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T1996 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2022 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2036 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2000 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801324 T2004 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801324 T2014 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801324 T2016 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801324 T2030 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2026 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T1998 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801324 T2008 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801326 T2040 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72ffaa name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801323 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801326 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801328 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801331 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
[junit4] 2> 801335 T2038 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801336 T2028 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801337 T2036 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801338 T1990 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801338 T2024 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801338 T2020 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801338 T2034 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801338 T2010 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801339 T2002 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801339 T1996 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801339 T2022 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801339 T2032 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801339 T2040 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2006 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2008 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2016 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2030 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T1998 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2018 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2012 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2026 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801340 T2014 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2000 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801343 T2042 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d0f108 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801340 T2004 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801343 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801345 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801348 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
[junit4] 2> 801353 T2038 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801354 T2006 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801354 T2008 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801355 T2034 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801356 T2022 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801356 T2032 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801356 T2018 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2016 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2004 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2028 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2020 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2024 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T1990 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2002 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2026 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2036 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T2014 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T2000 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T2030 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T2042 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801359 T1998 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801359 T2012 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801359 T2010 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801359 T1996 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T2040 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801360 T2044 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65fae8 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801361 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801362 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801365 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
[junit4] 2> 801372 T2040 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801372 T2028 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801374 T1996 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801374 T2010 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801375 T1990 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801376 T2014 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801376 T2044 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801376 T2000 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801376 T2006 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2020 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801377 T2004 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2042 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2026 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801378 T2036 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2008 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801378 T1998 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801379 T2046 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13ae643 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801378 T2012 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801379 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801377 T2016 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2018 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2030 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2038 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2034 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2024 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2002 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2022 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2032 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801381 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801385 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
[junit4] 2> 801390 T1998 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801391 T1996 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801391 T2010 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801391 T2012 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T1990 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2034 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2004 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2024 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2016 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2040 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2036 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801395 T2018 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801395 T2030 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801401 T2032 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801401 T2022 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801402 T2026 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801402 T2002 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801402 T2020 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801402 T2042 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2028 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2000 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2044 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2014 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2046 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801403 T2038 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2006 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2008 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801406 T2048 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1628d15 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801406 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801407 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801409 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
[junit4] 2> 801417 T1996 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2006 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2008 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2046 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2038 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2034 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2024 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2002 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2022 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2020 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801419 T2032 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801419 T2036 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801419 T2026 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801419 T2042 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801419 T2004 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2014 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2000 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2016 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2018 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801420 T1998 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2012 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2048 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2040 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2030 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2010 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T1990 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2028 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2044 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801423 T2050 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bba52 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801423 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801424 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801427 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
[junit4] 2> 801432 T2032 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801433 T2048 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2002 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2008 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2004 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2024 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2020 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2006 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2016 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801436 T2014 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801436 T2022 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801436 T2000 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2018 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801437 T2040 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2030 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2042 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801436 T2050 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801436 T2034 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2026 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2044 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2028 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T1990 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T1996 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2012 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T1998 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2010 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2036 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2038 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2046 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801445 T2052 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@115ff44 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801445 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801451 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801454 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
[junit4] 2> 801462 T2044 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801462 T1990 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801462 T2028 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T2010 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T2052 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T2040 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T1998 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T2024 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T2012 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801467 T2038 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801467 T2050 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801467 T2048 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801467 T2026 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801468 T2016 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801468 T2018 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801468 T2032 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801468 T2020 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2046 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2034 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2002 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T1996 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2036 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2042 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2004 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2000 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2022 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801470 T2030 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801471 T2008 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801471 T2014 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801471 T2006 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801473 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801477 T2054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fd5ea9 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801477 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801479 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801481 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
[junit4] 2> 801489 T2036 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801490 T2044 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801490 T2014 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801490 T2028 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801490 T1990 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801490 T2040 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801491 T2000 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801491 T2042 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801491 T2026 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801491 T2004 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801491 T2030 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T2054 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801492 T2002 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T2024 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2020 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2032 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2022 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2046 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2038 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T2016 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T2018 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T1998 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T2050 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801494 T2056 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1aec783 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801493 T2012 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2010 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T1996 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2052 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2048 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2006 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2008 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2034 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801495 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801498 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801502 T1963 oascc.SolrZkClient.makePath makePath: /liv
[...truncated too long message...]
_total_number=0}
[junit4] 2> 1310358 T3594 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 1310358 T3594 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1310358 T3594 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1310359 T3594 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1310359 T3594 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1310359 T3594 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\index [CachedDir<<refCount=0;path=.\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\index;done=false>>]
[junit4] 2> 1310359 T3594 oasc.CachingDirectoryFactory.close Closing directory: .\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\index
[junit4] 2> 1310359 T3594 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\ [CachedDir<<refCount=0;path=.\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\;done=false>>]
[junit4] 2> 1310359 T3594 oasc.CachingDirectoryFactory.close Closing directory: .\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\
[junit4] 2> 1310359 T3594 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1310362 T3594 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:143)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:298)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:130)
[junit4] 2> ... 7 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:209)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:417)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:135)
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
[junit4] 2> ... 8 more
[junit4] 2>
[junit4] 2> 1310362 T3594 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1310362 T3594 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene49), sim=DefaultSimilarity, locale=es_HN, timezone=Asia/Kuala_Lumpur
[junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60 (32-bit)/cpus=2,threads=1,free=61520680,total=168554496
[junit4] 2> NOTE: All tests run in this JVM: [TestJmxIntegration, OpenCloseCoreStressTest, CursorMarkTest, HdfsBasicDistributedZk2Test, DocumentAnalysisRequestHandlerTest, DistributedDebugComponentTest, AnalyticsQueryTest, SOLR749Test, PolyFieldTest, TestQueryUtils, SpellPossibilityIteratorTest, TestManagedSchemaFieldResource, SolrCoreTest, HdfsSyncSliceTest, TermsComponentTest, TestPseudoReturnFields, CollectionsAPIDistributedZkTest, TestDistributedSearch, DistributedExpandComponentTest, SimplePostToolTest, TestRealTimeGet, ReplicationFactorTest, BasicZkTest, TestStressVersions, DistanceFunctionTest, TestLeaderElectionZkExpiry, TestStressReorder, TestSearchPerf, LeaderElectionIntegrationTest, IndexSchemaRuntimeFieldTest, TestFieldCollectionResource, TestWriterPerf, TestDistribDocBasedVersion, TestLRUCache, TestCSVLoader, TestElisionMultitermQuery, SuggesterTest, TestJoin, AtomicUpdatesTest, TestConfig, CursorPagingTest, TestRangeQuery, TestExceedMaxTermLength, TestCursorMarkWithoutUniqueKey, TestPerFieldSimilarity, TestPostingsSolrHighlighter, OverseerTest, TestSuggestSpellingConverter, DocValuesTest, IndexSchemaTest, LegacyHTMLStripCharFilterTest, DocumentBuilderTest, TestNRTOpen, SoftAutoCommitTest, NoCacheHeaderTest, TestInitQParser, TestReload, CoreMergeIndexesAdminHandlerTest, TestSolrCoreProperties, TestCollectionAPI, QueryElevationComponentTest, TestExtendedDismaxParser, RegexBoostProcessorTest, AnalyticsMergeStrategyTest, HdfsUnloadDistributedZkTest, ExternalFileFieldSortTest, RAMDirectoryFactoryTest, JsonLoaderTest, TestSchemaNameResource, DistributedSuggestComponentTest, OpenExchangeRatesOrgProviderTest, TestMergePolicyConfig, ClusterStateUpdateTest, DistributedQueryComponentCustomSortTest, TestBinaryField, OverseerRolesTest, NotRequiredUniqueKeyTest, ChaosMonkeyNothingIsSafeTest, BadCopyFieldTest, TestSolrDeletionPolicy1, CurrencyFieldXmlFileTest, HardAutoCommitTest, BasicFunctionalityTest, MultiThreadedOCPTest]
[junit4] Completed in 128.30s, 1 test, 1 failure <<< FAILURES!
[...truncated 990 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1299: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:923: There were test failures: 406 suites, 1658 tests, 1 error, 1 failure, 42 ignored (21 assumptions)
Total time: 114 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_60 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any