You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/01/26 00:21:16 UTC
[JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 496 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/496/
All tests passed
Build Log:
[...truncated 19387 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:466: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:86: The following files contain @author tags, tabs or nocommits:
* lucene/core/src/java/org/apache/lucene/util/PriorityQueue.java
Total time: 157 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
UILD\\s+FAILED(?s:.*+) \
)"}
[JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 497 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/497/
1 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
Stack Trace:
org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at __randomizedtesting.SeedInfo.seed([D32C3E4D31B26C36:D724B1BE23178317]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:428)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:425)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:382)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:369)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:156)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:289)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:153)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:584)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 9525 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> 745618 T1172 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solrtest-OverseerTest-1390803240326
[junit4] 2> 745619 T1172 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 745624 T1172 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignment
[junit4] 2> 745625 T1172 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 745626 T1173 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 745726 T1172 oasc.ZkTestServer.run start zk server on port:56645
[junit4] 2> 745727 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 745731 T1179 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53e9e2c name:ZooKeeperConnection Watcher:127.0.0.1:56645 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 745732 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 745735 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 745737 T1181 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@613d1ad2 name:ZooKeeperConnection Watcher:127.0.0.1:56645 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 745737 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 745738 T1172 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 745755 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 745757 T1183 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c617023 name:ZooKeeperConnection Watcher:127.0.0.1:56645/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 745757 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 745758 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 745761 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 745763 T1185 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2eb3ba7 name:ZooKeeperConnection Watcher:127.0.0.1:56645/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 745763 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 745765 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 745768 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 745774 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 745777 T1172 oasc.Overseer.start Overseer (id=91147681158922243-127.0.0.1:56645_solr-n_0000000000) starting
[junit4] 2> 745780 T1172 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 745784 T1172 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 745788 T1172 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 745792 T1187 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 745792 T1172 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 745792 T1187 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 745793 T1186 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 745796 T1172 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 745798 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 745802 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 745804 T1189 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27b80c47 name:ZooKeeperConnection Watcher:127.0.0.1:56645/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 745804 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 745806 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 745809 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1
[junit4] 2> 745813 T1183 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 745813 T1189 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 745816 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 745818 T1186 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 745818 T1186 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 745819 T1186 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 745819 T1186 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 745823 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 745824 T1189 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 745824 T1183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 746317 T1172 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 746340 T1172 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 746347 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 746350 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 746350 T1186 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 746356 T1186 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 746356 T1186 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 746356 T1186 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 746360 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 746463 T1183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 746463 T1189 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 746851 T1172 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 746899 T1172 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 746905 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 746906 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 746906 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 746908 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 746908 T1186 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 746913 T1186 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 746914 T1186 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 746914 T1186 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 746917 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 747045 T1189 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 747045 T1183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 747409 T1172 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 747434 T1172 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 747448 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 747448 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 747449 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 747451 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 747451 T1186 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 747461 T1186 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node4",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 747461 T1186 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 747462 T1186 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 747465 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 747569 T1183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 747569 T1189 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 747952 T1172 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 747973 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 747973 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 747973 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 747975 T1186 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 747976 T1186 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core5",
[junit4] 2> "core_node_name":"node5",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 747976 T1186 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 747976 T1186 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 747980 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 748084 T1183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 748084 T1189 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 748474 T1172 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 748492 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 748493 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 748493 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 748495 T1186 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 748496 T1186 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core6",
[junit4] 2> "core_node_name":"node6",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 748496 T1186 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 748496 T1186 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 748500 T1185 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 748603 T1183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 748603 T1189 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 748994 T1172 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 749011 T1189 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 749024 T1172 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:56645 56645
[junit4] 2> 749094 T1172 oas.SolrTestCaseJ4.tearDown ###Ending testShardAssignment
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 749102 T1172 oas.SolrTestCaseJ4.setUp ###Starting testPlaceholders
[junit4] 2> 749102 T1172 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 749103 T1190 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 749204 T1172 oasc.ZkTestServer.run start zk server on port:21462
[junit4] 2> 749205 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 749209 T1196 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e68140d name:ZooKeeperConnection Watcher:127.0.0.1:21462/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 749209 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 749210 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 749212 T1198 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15580275 name:ZooKeeperConnection Watcher:127.0.0.1:21462 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 749213 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 749265 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 749267 T1200 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@448af90e name:ZooKeeperConnection Watcher:127.0.0.1:21462 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 749267 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 749267 T1172 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 749271 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 749274 T1172 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 749277 T1172 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 749279 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 749283 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 749285 T1202 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65e17d40 name:ZooKeeperConnection Watcher:127.0.0.1:21462/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 749285 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 749286 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 749289 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 749293 T1196 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 749293 T1202 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 749294 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 749296 T1204 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62861410 name:ZooKeeperConnection Watcher:127.0.0.1:21462/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 749297 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 749298 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 749301 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 749314 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 749317 T1172 oasc.Overseer.start Overseer (id=91147681387380740-127.0.0.1:21462_solr-n_0000000000) starting
[junit4] 2> 749326 T1172 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 749331 T1172 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 749340 T1172 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 749343 T1206 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 749345 T1206 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 749345 T1205 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 749355 T1205 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 749356 T1205 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=12 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"12",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 749356 T1205 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8, shard9, shard10, shard11, shard12]
[junit4] 2> 749356 T1205 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 749360 T1204 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 749362 T1202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 749362 T1196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 749854 T1172 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 749883 T1172 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 749891 T1204 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 749892 T1172 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 749893 T1205 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 749896 T1196 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 749896 T1202 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 749903 T1172 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:21462 21462
[junit4] 2> 750079 T1172 oas.SolrTestCaseJ4.tearDown ###Ending testPlaceholders
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 750087 T1172 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4] 2> 750087 T1172 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 750088 T1207 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 750189 T1172 oasc.ZkTestServer.run start zk server on port:33706
[junit4] 2> 750190 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750194 T1213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d169b32 name:ZooKeeperConnection Watcher:127.0.0.1:33706 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750194 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750244 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750246 T1215 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@119863e1 name:ZooKeeperConnection Watcher:127.0.0.1:33706 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750246 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750247 T1172 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 750251 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750253 T1217 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4aece15b name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750253 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750253 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 750256 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750258 T1219 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6380458 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750258 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750260 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 750262 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 750268 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 750271 T1172 oasc.Overseer.start Overseer (id=91147681451802627-127.0.0.1:33706_solr-n_0000000000) starting
[junit4] 2> 750274 T1172 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 750279 T1172 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 750284 T1172 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 750287 T1221 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 750287 T1172 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 750288 T1221 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 750288 T1220 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 750291 T1172 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 750294 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750298 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750300 T1223 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73010628 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750300 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750302 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750305 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4] 2> 750309 T1217 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 750309 T1223 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 750310 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750312 T1225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@408e379f name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750312 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750314 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750317 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 750321 T1217 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 750321 T1223 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 750321 T1225 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 750322 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750324 T1227 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ee986dc name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750324 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750326 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750329 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 750332 T1217 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 750332 T1223 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 750333 T1227 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 750332 T1225 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 750333 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750336 T1229 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@139b50a6 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750336 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750338 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750340 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4] 2> 750344 T1227 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 750344 T1225 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 750344 T1229 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 750344 T1217 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 750344 T1223 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 750345 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750347 T1231 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1981eab9 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750347 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750348 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750351 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4] 2> 750355 T1223 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750355 T1231 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750355 T1217 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750355 T1229 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750355 T1225 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750355 T1227 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750356 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750358 T1233 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c87d406 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750358 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750360 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750362 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4] 2> 750366 T1233 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 750366 T1229 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 750366 T1225 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 750366 T1217 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 750366 T1231 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 750367 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750366 T1227 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 750366 T1223 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 750369 T1235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3839e494 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750369 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750371 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750374 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4] 2> 750378 T1233 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 750378 T1223 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 750378 T1229 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 750378 T1231 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 750378 T1225 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 750379 T1227 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 750378 T1235 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 750378 T1217 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 750380 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750382 T1237 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75eccec2 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750382 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750384 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750387 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4] 2> 750390 T1233 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 750390 T1231 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 750391 T1223 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 750391 T1235 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 750391 T1225 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 750391 T1217 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 750392 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750391 T1229 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 750391 T1227 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 750391 T1237 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 750394 T1239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5fcc247d name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750395 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750396 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750399 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4] 2> 750404 T1237 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 750404 T1229 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 750404 T1223 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 750404 T1225 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 750404 T1235 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 750404 T1231 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 750404 T1217 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 750404 T1233 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 750405 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750404 T1227 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 750404 T1239 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 750407 T1241 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33ebf426 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750408 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750409 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750412 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4] 2> 750416 T1237 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 750417 T1225 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 750417 T1229 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 750417 T1223 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 750418 T1227 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 750417 T1235 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 750417 T1241 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 750417 T1231 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 750417 T1239 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 750419 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750418 T1217 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 750418 T1233 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 750421 T1243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@467f4212 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750421 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750423 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750426 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4] 2> 750430 T1225 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750431 T1229 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750431 T1231 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750431 T1223 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750431 T1235 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750431 T1239 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750431 T1237 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750431 T1217 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750431 T1241 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750430 T1243 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750430 T1233 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750437 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750431 T1227 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 750440 T1245 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e8ad773 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750440 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750442 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750445 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4] 2> 750449 T1239 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750450 T1229 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750450 T1241 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750450 T1225 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750450 T1217 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750449 T1223 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750449 T1243 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750451 T1227 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750450 T1245 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750450 T1231 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750450 T1237 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750450 T1233 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750450 T1235 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 750452 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750454 T1247 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44c2beb9 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750454 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750456 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750459 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4] 2> 750463 T1229 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750463 T1223 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750463 T1239 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750463 T1225 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750464 T1245 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750464 T1235 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750464 T1237 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750464 T1241 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750464 T1233 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750464 T1217 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750464 T1231 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750464 T1227 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750464 T1243 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750465 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750467 T1249 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35ae691f name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750465 T1247 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 750468 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750470 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750473 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4] 2> 750477 T1243 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750477 T1233 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750477 T1217 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750477 T1223 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750477 T1225 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750477 T1239 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750479 T1241 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750479 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750477 T1229 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750479 T1231 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750479 T1237 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750479 T1247 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750478 T1249 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750478 T1227 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750478 T1235 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750478 T1245 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 750481 T1251 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30e22232 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750482 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750484 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750487 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4] 2> 750491 T1225 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750492 T1243 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750492 T1241 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750492 T1247 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750492 T1237 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750493 T1227 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750492 T1229 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750492 T1239 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750492 T1233 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750492 T1217 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750492 T1235 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750491 T1223 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750494 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750493 T1251 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750493 T1249 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750493 T1231 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750493 T1245 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 750496 T1253 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74c4810a name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750497 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750498 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750501 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4] 2> 750505 T1223 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750506 T1235 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750506 T1241 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750506 T1243 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750506 T1231 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750506 T1217 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750506 T1225 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750508 T1249 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750508 T1233 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750508 T1251 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750507 T1239 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750507 T1237 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750507 T1229 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750507 T1247 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750507 T1245 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750507 T1253 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750506 T1227 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 750508 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750510 T1255 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43ca8759 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750511 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750513 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750513 T1189 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard3/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 750514 T1189 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 750514 T1189 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 750516 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4] 2> 750521 T1243 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750521 T1229 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750521 T1239 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750522 T1253 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750522 T1233 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750522 T1231 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750523 T1251 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750522 T1237 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750521 T1247 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750521 T1235 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750524 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750521 T1217 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750521 T1225 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750521 T1223 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750523 T1255 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750523 T1249 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750522 T1245 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750522 T1227 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750522 T1241 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 750526 T1257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65e1bc74 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750527 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750529 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750532 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4] 2> 750537 T1235 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750537 T1231 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750537 T1253 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1217 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1245 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1255 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750539 T1239 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1243 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1233 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1249 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750540 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750539 T1257 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750539 T1237 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750539 T1251 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1247 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1241 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1227 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1229 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1225 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750538 T1223 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 750542 T1259 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a68f047 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750543 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750544 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750547 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4] 2> 750551 T1229 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750552 T1243 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750552 T1249 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750553 T1233 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750552 T1237 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750552 T1223 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750552 T1217 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750552 T1247 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750552 T1225 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750552 T1239 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750552 T1241 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750552 T1253 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750551 T1235 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750554 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750553 T1255 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750553 T1257 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750553 T1227 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750553 T1245 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750553 T1259 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750553 T1231 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750553 T1251 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 750556 T1261 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f88495b name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750558 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750559 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750562 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4] 2> 750566 T1223 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750566 T1225 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1243 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1245 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1233 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1251 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1237 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1253 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1249 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1229 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1217 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1241 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1247 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750567 T1235 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750566 T1239 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750569 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750568 T1227 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750568 T1257 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750568 T1255 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750568 T1259 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750568 T1231 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750568 T1261 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 750571 T1263 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@247a63fc name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750572 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750574 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750577 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4] 2> 750581 T1243 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750581 T1229 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750582 T1235 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750582 T1239 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750583 T1247 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750582 T1233 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750583 T1227 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750584 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750582 T1223 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750584 T1231 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750584 T1245 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750584 T1225 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750583 T1217 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750583 T1241 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750583 T1255 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750583 T1259 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750583 T1249 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750583 T1261 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750583 T1263 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750582 T1253 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750582 T1251 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750582 T1257 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750582 T1237 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 750586 T1265 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b3b6cdf name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750588 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750589 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750592 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4] 2> 750597 T1223 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750597 T1259 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750598 T1239 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750597 T1225 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750598 T1235 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750598 T1245 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750597 T1243 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750597 T1229 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750599 T1247 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750599 T1261 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750599 T1257 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750599 T1263 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750599 T1237 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750599 T1251 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750599 T1249 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750598 T1265 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750598 T1253 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750598 T1255 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750598 T1227 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750602 T1267 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@318f94e9 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750598 T1217 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750598 T1233 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750598 T1241 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750598 T1231 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 750600 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750604 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750605 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750608 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
[junit4] 2> 750612 T1223 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750613 T1243 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750613 T1257 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750613 T1229 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750614 T1261 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750613 T1239 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750613 T1265 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750615 T1249 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750615 T1237 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750615 T1245 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750614 T1241 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750614 T1227 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750614 T1247 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750616 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750614 T1263 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750614 T1235 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750614 T1267 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750614 T1253 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750614 T1217 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750614 T1225 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750616 T1251 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750615 T1255 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750619 T1269 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9747164 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750615 T1231 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750615 T1233 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750615 T1259 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 750619 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750621 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750624 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
[junit4] 2> 750629 T1223 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750629 T1261 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750629 T1265 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750630 T1231 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750630 T1267 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750631 T1249 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750631 T1245 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750630 T1247 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750629 T1229 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750629 T1233 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750629 T1227 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750629 T1217 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750632 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750631 T1239 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750631 T1253 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750631 T1251 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750631 T1235 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750634 T1271 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bfbe39e name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750631 T1255 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750631 T1237 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750630 T1269 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750630 T1257 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750630 T1241 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750630 T1263 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750630 T1259 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750630 T1225 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750630 T1243 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 750634 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750638 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750640 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
[junit4] 2> 750644 T1223 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750645 T1261 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750646 T1235 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750645 T1253 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1231 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750645 T1227 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750645 T1257 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1271 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1249 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1233 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1255 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1241 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1217 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1247 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1229 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1267 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1265 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1251 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750647 T1259 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750646 T1263 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750646 T1245 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750646 T1237 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750646 T1239 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750646 T1225 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750646 T1269 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750646 T1243 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 750650 T1273 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2342c6a6 name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750648 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750653 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750655 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750657 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
[junit4] 2> 750662 T1223 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750662 T1271 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750662 T1217 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750663 T1261 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750663 T1247 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1245 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750663 T1229 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750663 T1239 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750663 T1227 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750663 T1253 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750663 T1259 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750663 T1265 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750663 T1251 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750662 T1225 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750665 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 750664 T1257 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1263 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1241 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1235 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1237 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1231 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1243 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1269 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1233 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1273 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1249 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1255 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750664 T1267 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 750667 T1275 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c88dabd name:ZooKeeperConnection Watcher:127.0.0.1:33706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 750670 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 750671 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKee
[...truncated too long message...]
cc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 773810 T1599 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e7defa6 name:ZooKeeperConnection Watcher:127.0.0.1:45787 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 773810 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 773863 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 773865 T1601 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@218bba6f name:ZooKeeperConnection Watcher:127.0.0.1:45787 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 773865 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 773866 T1172 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 773868 T1172 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 773870 T1172 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 773872 T1172 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 773874 T1172 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 773877 T1172 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 773881 T1172 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 773882 T1603 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33100348 name:ZooKeeperConnection Watcher:127.0.0.1:45787/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 773883 T1172 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 773884 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 773886 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 773889 T1172 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 773891 T1172 oasc.Overseer.start Overseer (id=91147682999173123-127.0.0.1:45787_solr-n_0000000000) starting
[junit4] 2> 773893 T1172 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 773898 T1172 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 773900 T1605 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 773901 T1605 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 773902 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 773902 T1604 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 773903 T1604 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 773904 T1597 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 773907 T1604 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core2",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 773908 T1597 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 773909 T1604 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 773911 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 773911 T1604 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core3",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 773914 T1603 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 773914 T1597 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 774006 T1172 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:45787 45787
[junit4] 2> 774137 T1172 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 774140 T1172 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 774140 T1172 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 774964 T1582 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 774964 T1582 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:413)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:382)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:369)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 774965 T1582 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 777141 T1172 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=zh, timezone=America/Paramaribo
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=1,free=222686592,total=344391680
[junit4] 2> NOTE: All tests run in this JVM: [TestReplicationHandler, DOMUtilTest, TestQueryUtils, CoreAdminCreateDiscoverTest, TestCloudManagedSchema, SolrXmlInZkTest, SampleTest, SchemaVersionSpecificBehaviorTest, OverseerTest]
[junit4] Completed on J0 in 31.57s, 8 tests, 1 error <<< FAILURES!
[...truncated 1005 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:466: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:439: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/common-build.xml:491: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1308: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:941: There were test failures: 355 suites, 1548 tests, 1 error, 33 ignored (5 assumptions)
Total time: 121 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
UILD\\s+FAILED(?s:.*+) \
)"}