You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/08/13 02:51:59 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_65) - Build #
11011 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11011/
Java: 32bit/jdk1.7.0_65 -server -XX:+UseParallelGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([FBF4C1976E4175FD:FFFC4E647CE49ADC]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:144)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:660)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:457)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:454)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:411)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:398)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:136)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:131)
... 47 more
Build Log:
[...truncated 11107 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.OverseerTest-FBF4C1976E4175FD-001/init-core-data-001
[junit4] 2> 224777 T677 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 224777 T677 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 224777 T677 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 224782 T677 oas.SolrTestCaseJ4.setUp ###Starting testStateChange
[junit4] 2> 224783 T677 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 224783 T678 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 224883 T677 oasc.ZkTestServer.run start zk server on port:52641
[junit4] 2> 224884 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 224886 T684 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bd37a4 name:ZooKeeperConnection Watcher:127.0.0.1:52641/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 224886 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 224887 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 224888 T686 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f7e952 name:ZooKeeperConnection Watcher:127.0.0.1:52641 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 224888 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 224891 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 224892 T688 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dafdcd name:ZooKeeperConnection Watcher:127.0.0.1:52641 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 224892 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 224892 T677 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 224895 T677 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 224897 T677 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 224899 T677 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 224900 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 224903 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 224904 T690 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17312e7 name:ZooKeeperConnection Watcher:127.0.0.1:52641/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 224904 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 224905 T677 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 224907 T677 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 224910 T677 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52641_solr
[junit4] 2> 224910 T677 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 224912 T677 oasc.Overseer.start Overseer (id=92267380597981187-127.0.0.1:52641_solr-n_0000000000) starting
[junit4] 2> 224913 T677 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 224916 T677 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 224918 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 224921 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 224923 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 224926 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 224929 T692 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 224930 T691 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 224931 T677 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 224931 T691 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 224932 T691 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 224932 T691 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 224934 T693 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 224934 T694 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 224982 T677 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 224984 T693 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 224985 T691 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 224986 T691 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"active"}
[junit4] 2> 224986 T691 oasc.Overseer$ClusterStateUpdater.updateState node=core_node1 is already registered
[junit4] 2> 224986 T691 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 225089 T694 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 225136 T677 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52641 52641
[junit4] 2> 225851 T678 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52641 52641
[junit4] 2> 225853 T677 oas.SolrTestCaseJ4.tearDown ###Ending testStateChange
[junit4] 2> 225853 T691 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:52641_solr
[junit4] 2> 225854 T695 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 225858 T677 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4] 2> 225859 T677 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 225859 T696 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 225959 T677 oasc.ZkTestServer.run start zk server on port:36243
[junit4] 2> 225960 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 225962 T702 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c66e1 name:ZooKeeperConnection Watcher:127.0.0.1:36243 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 225962 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 225965 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 225966 T704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11ceb6b name:ZooKeeperConnection Watcher:127.0.0.1:36243 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 225967 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 225967 T677 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 225970 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 225971 T706 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1951e64 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 225971 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 225972 T677 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 225974 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 225975 T708 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a4e022 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 225975 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 225976 T677 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 225977 T677 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 225980 T677 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:36243_solr
[junit4] 2> 225980 T677 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 225982 T677 oasc.Overseer.start Overseer (id=92267380668497923-127.0.0.1:36243_solr-n_0000000000) starting
[junit4] 2> 225983 T677 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 225985 T677 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 225987 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 225988 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 225990 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 225992 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 225994 T710 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 225995 T677 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 225995 T709 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 225996 T677 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 225997 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 225999 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226000 T712 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@156e60a name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226000 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226001 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226002 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4] 2> 226004 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226005 T716 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bdc331 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226005 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226006 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226007 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 226009 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226010 T719 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cf502a name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226010 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226011 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226012 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 226014 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226015 T722 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1321dba name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226015 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226016 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226017 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4] 2> 226020 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226020 T725 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1768265 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226021 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226021 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226023 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4] 2> 226025 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226026 T728 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d1729f name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226026 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226027 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226028 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4] 2> 226031 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226031 T731 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1387b8b name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226032 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226032 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226034 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4] 2> 226036 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226037 T734 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10cfb name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226037 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226038 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226040 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4] 2> 226042 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226043 T737 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e028d1 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226043 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226044 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226046 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4] 2> 226049 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226050 T740 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8e7a67 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226050 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226051 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226053 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4] 2> 226056 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226057 T743 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1416ef1 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226057 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226058 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226059 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4] 2> 226062 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226063 T746 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a18e0f name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226063 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226064 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226066 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4] 2> 226081 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226082 T749 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a10e37 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226082 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226083 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226085 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4] 2> 226089 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226090 T752 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14bca5b name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226090 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226091 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226093 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4] 2> 226097 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226098 T755 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b734e3 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226098 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226099 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226100 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4] 2> 226103 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226104 T758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c5451d name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226104 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226105 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226107 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4] 2> 226110 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226111 T761 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45eeaf name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226111 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226112 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226113 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4] 2> 226118 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226119 T764 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c26e21 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226119 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226120 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226122 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4] 2> 226133 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226134 T767 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14c8818 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226134 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226135 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226137 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4] 2> 226142 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226143 T770 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dbf47a name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226143 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226144 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226145 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4] 2> 226161 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226162 T773 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@89f86f name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226162 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226163 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226165 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4] 2> 226169 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226170 T776 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11bc5f5 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226170 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226171 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226173 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4] 2> 226180 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226180 T778 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e31483 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226181 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226182 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226184 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
[junit4] 2> 226189 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226190 T782 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cd56d8 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226191 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226191 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226193 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
[junit4] 2> 226208 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226209 T785 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f3d224 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226209 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226210 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226212 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
[junit4] 2> 226217 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226218 T788 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18dcc5a name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226219 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226219 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226221 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
[junit4] 2> 226228 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226229 T791 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d59f8 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226229 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226230 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226231 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
[junit4] 2> 226236 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226237 T794 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@119451d name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226237 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226238 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226240 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
[junit4] 2> 226245 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226245 T797 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36b1eb name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226247 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226248 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226250 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
[junit4] 2> 226255 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226256 T800 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1747280 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226256 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226256 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226258 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
[junit4] 2> 226263 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226264 T803 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@156c371 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226265 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226266 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226267 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node30
[junit4] 2> 226272 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226273 T806 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1761200 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226273 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226274 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226275 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node31
[junit4] 2> 226280 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226281 T809 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10043ef name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226281 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226282 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226283 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node32
[junit4] 2> 226290 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226291 T812 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b0b1 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226292 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226293 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226296 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node33
[junit4] 2> 226302 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226304 T815 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10ba0c8 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226304 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226306 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226308 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node34
[junit4] 2> 226315 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226318 T818 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14887a4 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226318 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226320 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226323 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node35
[junit4] 2> 226332 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226333 T821 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@142538f name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226334 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226334 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226336 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node36
[junit4] 2> 226342 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226343 T824 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f4cd3c name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226343 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226344 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226346 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node37
[junit4] 2> 226352 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226353 T827 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aa6137 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226353 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226354 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226355 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node38
[junit4] 2> 226360 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226361 T830 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1060d6b name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226361 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226362 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226364 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node39
[junit4] 2> 226375 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226376 T833 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26802f name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226377 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226378 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226381 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node40
[junit4] 2> 226393 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226393 T836 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b7818 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226394 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226395 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226396 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node41
[junit4] 2> 226402 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226403 T839 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bf34fa name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226404 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226404 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226406 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node42
[junit4] 2> 226413 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226414 T842 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f409a name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226414 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226414 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226416 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node43
[junit4] 2> 226423 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226423 T845 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1522359 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226424 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226424 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226426 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node44
[junit4] 2> 226432 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226433 T848 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23710b name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226433 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226434 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226435 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node45
[junit4] 2> 226441 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226442 T851 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@173b544 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226443 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226443 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226445 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node46
[junit4] 2> 226452 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226453 T854 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ed6b6c name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226454 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226455 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226459 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node47
[junit4] 2> 226468 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226470 T857 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f675b6 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226471 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226472 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226475 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node48
[junit4] 2> 226485 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 226487 T860 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d55212 name:ZooKeeperConnection Watcher:127.0.0.1:36243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 226487 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 226488 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 226491 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node49
[junit4] 2> 226507 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226515 T709 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 226516 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node0",
[junit4] 2> "core":"core0",
[junit4] 2> "core_node_name":"node0",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node0/solr/"}
[junit4] 2> 226517 T709 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8]
[junit4] 2> 226517 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 226520 T732 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226520 T834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T804 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T744 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T831 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T789 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T816 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T846 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T852 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T783 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T714 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226520 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226520 T828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226520 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226520 T858 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226520 T750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T713 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T843 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T792 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226528 T709 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 226522 T801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T779 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T795 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226522 T840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226529 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 226521 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T786 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T762 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T723 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T729 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T798 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T753 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T759 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226521 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226529 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226528 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 50)
[junit4] 2> 226533 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard7
[junit4] 2> 226535 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 226535 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226535 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 226537 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node5",
[junit4] 2> "core":"core5",
[junit4] 2> "core_node_name":"node5",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node5/solr/"}
[junit4] 2> 226537 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226537 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard6
[junit4] 2> 226540 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node4",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node4",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node4/solr/"}
[junit4] 2> 226540 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226540 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard4
[junit4] 2> 226540 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226544 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node3",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node3/solr/"}
[junit4] 2> 226544 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226544 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 226544 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226547 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node6",
[junit4] 2> "core":"core6",
[junit4] 2> "core_node_name":"node6",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node6/solr/"}
[junit4] 2> 226547 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226547 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard5
[junit4] 2> 226549 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226550 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node7",
[junit4] 2> "core":"core7",
[junit4] 2> "core_node_name":"node7",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node7/solr/"}
[junit4] 2> 226550 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226550 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard8
[junit4] 2> 226552 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node8",
[junit4] 2> "core":"core8",
[junit4] 2> "core_node_name":"node8",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node8/solr/"}
[junit4] 2> 226552 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226552 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 226554 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226555 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node12",
[junit4] 2> "core":"core12",
[junit4] 2> "core_node_name":"node12",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node12/solr/"}
[junit4] 2> 226555 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226555 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard7
[junit4] 2> 226557 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node15",
[junit4] 2> "core":"core15",
[junit4] 2> "core_node_name":"node15",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node15/solr/"}
[junit4] 2> 226558 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226558 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 226559 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226560 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node13",
[junit4] 2> "core":"core13",
[junit4] 2> "core_node_name":"node13",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node13/solr/"}
[junit4] 2> 226560 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226560 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard6
[junit4] 2> 226563 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226563 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node11",
[junit4] 2> "core":"core11",
[junit4] 2> "core_node_name":"node11",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node11/solr/"}
[junit4] 2> 226563 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226563 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard4
[junit4] 2> 226566 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node14",
[junit4] 2> "core":"core14",
[junit4] 2> "core_node_name":"node14",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node14/solr/"}
[junit4] 2> 226566 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226566 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 226568 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226568 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node10",
[junit4] 2> "core":"core10",
[junit4] 2> "core_node_name":"node10",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node10/solr/"}
[junit4] 2> 226569 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226569 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard5
[junit4] 2> 226571 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node9",
[junit4] 2> "core":"core9",
[junit4] 2> "core_node_name":"node9",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node9/solr/"}
[junit4] 2> 226571 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226571 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard8
[junit4] 2> 226573 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226575 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node17",
[junit4] 2> "core":"core17",
[junit4] 2> "core_node_name":"node17",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node17/solr/"}
[junit4] 2> 226575 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226575 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 226578 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node18",
[junit4] 2> "core":"core18",
[junit4] 2> "core_node_name":"node18",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node18/solr/"}
[junit4] 2> 226579 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226579 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard7
[junit4] 2> 226580 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226581 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node21",
[junit4] 2> "core":"core21",
[junit4] 2> "core_node_name":"node21",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node21/solr/"}
[junit4] 2> 226581 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226581 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 226583 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node20",
[junit4] 2> "core":"core20",
[junit4] 2> "core_node_name":"node20",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node20/solr/"}
[junit4] 2> 226583 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226583 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard6
[junit4] 2> 226585 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226585 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node19",
[junit4] 2> "core":"core19",
[junit4] 2> "core_node_name":"node19",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node19/solr/"}
[junit4] 2> 226585 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226586 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard4
[junit4] 2> 226587 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node16",
[junit4] 2> "core":"core16",
[junit4] 2> "core_node_name":"node16",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node16/solr/"}
[junit4] 2> 226588 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226588 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 226589 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226590 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node24",
[junit4] 2> "core":"core24",
[junit4] 2> "core_node_name":"node24",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node24/solr/"}
[junit4] 2> 226590 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226590 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard5
[junit4] 2> 226592 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node23",
[junit4] 2> "core":"core23",
[junit4] 2> "core_node_name":"node23",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node23/solr/"}
[junit4] 2> 226592 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226592 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard8
[junit4] 2> 226594 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226594 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node22",
[junit4] 2> "core":"core22",
[junit4] 2> "core_node_name":"node22",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node22/solr/"}
[junit4] 2> 226594 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226594 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 226596 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node27",
[junit4] 2> "core":"core27",
[junit4] 2> "core_node_name":"node27",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node27/solr/"}
[junit4] 2> 226597 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226597 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard7
[junit4] 2> 226598 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226599 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node28",
[junit4] 2> "core":"core28",
[junit4] 2> "core_node_name":"node28",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node28/solr/"}
[junit4] 2> 226599 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226599 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 226601 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node26",
[junit4] 2> "core":"core26",
[junit4] 2> "core_node_name":"node26",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node26/solr/"}
[junit4] 2> 226602 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226602 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard6
[junit4] 2> 226604 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226604 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node29",
[junit4] 2> "core":"core29",
[junit4] 2> "core_node_name":"node29",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node29/solr/"}
[junit4] 2> 226605 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226605 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard4
[junit4] 2> 226606 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node25",
[junit4] 2> "core":"core25",
[junit4] 2> "core_node_name":"node25",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node25/solr/"}
[junit4] 2> 226607 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226607 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 226608 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226609 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node30",
[junit4] 2> "core":"core30",
[junit4] 2> "core_node_name":"node30",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node30/solr/"}
[junit4] 2> 226609 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226609 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard5
[junit4] 2> 226611 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node33",
[junit4] 2> "core":"core33",
[junit4] 2> "core_node_name":"node33",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node33/solr/"}
[junit4] 2> 226611 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226611 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard8
[junit4] 2> 226613 T870 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226613 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node32",
[junit4] 2> "core":"core32",
[junit4] 2> "core_node_name":"node32",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"8",
[junit4] 2> "base_url":"http://node32/solr/"}
[junit4] 2> 226614 T709 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=8
[junit4] 2> 226614 T709 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 226617 T709 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=8 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state"
[...truncated too long message...]
.solr.common.cloud.ConnectionManager@97aff5 name:ZooKeeperConnection Watcher:127.0.0.1:49316 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 303454 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 303456 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 303457 T1282 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f875ab name:ZooKeeperConnection Watcher:127.0.0.1:49316 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 303458 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 303458 T677 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 303461 T677 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 303463 T677 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 303465 T677 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 303466 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 303468 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 303470 T1284 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a5ec95 name:ZooKeeperConnection Watcher:127.0.0.1:49316/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 303470 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 303471 T677 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 303473 T677 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 303475 T677 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 303476 T1288 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1febcc8 name:ZooKeeperConnection Watcher:127.0.0.1:49316/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 303476 T677 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 303477 T677 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 303478 T677 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 303481 T677 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49316_solr
[junit4] 2> 303481 T677 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 303483 T677 oasc.Overseer.start Overseer (id=92267385746817028-127.0.0.1:49316_solr-n_0000000000) starting
[junit4] 2> 303484 T677 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 303487 T677 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 303489 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 303491 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 303493 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 303495 T677 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 303498 T1290 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 303498 T1289 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 303500 T1289 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 303501 T1289 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=12 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"12",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 303501 T1289 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8, shard9, shard10, shard11, shard12]
[junit4] 2> 303502 T1289 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 303503 T1291 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 303504 T1285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 303504 T1286 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 303999 T677 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 304004 T677 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 304007 T1291 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 304007 T677 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 304008 T1289 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 304010 T677 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49316 49316
[junit4] 2> 304576 T1272 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49316 49316
[junit4] 2> 304578 T677 oas.SolrTestCaseJ4.tearDown ###Ending testPlaceholders
[junit4] 2> 304578 T1289 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:49316_solr
[junit4] 2> 304578 T1292 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 307580 T677 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.OverseerTest-FBF4C1976E4175FD-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene49), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=bg, timezone=Australia/Queensland
[junit4] 2> NOTE: Linux 3.13.0-32-generic i386/Oracle Corporation 1.7.0_65 (32-bit)/cpus=8,threads=1,free=7284928,total=263454720
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrJ, DistributedDebugComponentTest, TestManagedSchema, TestReload, TestSuggestSpellingConverter, TestLuceneMatchVersion, TestWordDelimiterFilterFactory, TestCodecSupport, TestFastOutputStream, TestDefaultSimilarityFactory, TestStressVersions, TestManagedStopFilterFactory, SystemInfoHandlerTest, TestSolrIndexConfig, NoCacheHeaderTest, ParsingFieldUpdateProcessorsTest, HdfsSyncSliceTest, TestSurroundQueryParser, BasicDistributedZkTest, XmlUpdateRequestHandlerTest, AnalyticsQueryTest, TestTrie, OverseerTest]
[junit4] Completed on J0 in 82.84s, 9 tests, 1 error <<< FAILURES!
[...truncated 1169 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:474: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:454: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1307: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 421 suites, 1761 tests, 1 error, 39 ignored (18 assumptions)
Total time: 83 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_65 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_65) - Build #
11012 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11012/
Java: 32bit/jdk1.7.0_65 -client -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([6641C8D44BE5DD9F:62494727594032BE]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:144)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:660)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:457)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:454)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:411)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:398)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:136)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:131)
... 47 more
Build Log:
[...truncated 11487 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.OverseerTest-6641C8D44BE5DD9F-001/init-core-data-001
[junit4] 2> 1667522 T4468 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1667522 T4468 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 1667522 T4468 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 1667525 T4468 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignment
[junit4] 2> 1667526 T4468 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1667526 T4469 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1667626 T4468 oasc.ZkTestServer.run start zk server on port:57571
[junit4] 2> 1667627 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1667640 T4475 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b61e92 name:ZooKeeperConnection Watcher:127.0.0.1:57571 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667640 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1667642 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1667643 T4477 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ff1df name:ZooKeeperConnection Watcher:127.0.0.1:57571 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667644 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1667644 T4468 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1667649 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1667650 T4479 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@190ef4e name:ZooKeeperConnection Watcher:127.0.0.1:57571/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667650 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1667651 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1667654 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1667655 T4481 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1929d0f name:ZooKeeperConnection Watcher:127.0.0.1:57571/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667655 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1667656 T4468 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1667659 T4468 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1667663 T4468 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:57571_solr
[junit4] 2> 1667664 T4468 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1667665 T4468 oasc.Overseer.start Overseer (id=92268298564468739-127.0.0.1:57571_solr-n_0000000000) starting
[junit4] 2> 1667667 T4468 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1667669 T4468 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1667672 T4468 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1667674 T4468 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1667676 T4468 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1667678 T4468 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1667682 T4483 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1667682 T4468 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1667682 T4482 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1667684 T4468 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1667685 T4468 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1667687 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1667688 T4485 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1aa7de8 name:ZooKeeperConnection Watcher:127.0.0.1:57571/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667688 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1667689 T4468 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1667690 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1
[junit4] 2> 1667693 T4488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1667694 T4482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1667694 T4482 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1667695 T4482 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 1667695 T4482 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1667697 T4486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1667697 T4487 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1668193 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 1668199 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 1668202 T4488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1668203 T4482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1668205 T4482 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1668205 T4482 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1668205 T4482 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1668206 T4488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1668207 T4487 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1668207 T4486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1668703 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1668708 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1668711 T4488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1668712 T4482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1668714 T4482 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1668715 T4482 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1668715 T4482 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1668716 T4488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1668717 T4487 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1668717 T4486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1669212 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1669216 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1669219 T4488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1669220 T4482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1669222 T4482 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node4",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1669223 T4482 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1669223 T4482 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1669224 T4488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1669225 T4486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1669225 T4487 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1669720 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 1669727 T4488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1669728 T4482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1669728 T4482 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core5",
[junit4] 2> "core_node_name":"node5",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1669729 T4482 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1669729 T4482 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1669832 T4486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1669832 T4487 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1670227 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1670232 T4488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1670233 T4482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1670234 T4482 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core6",
[junit4] 2> "core_node_name":"node6",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1670234 T4482 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1670234 T4482 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1670336 T4487 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1670336 T4486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1670732 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1670738 T4489 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1670738 T4485 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1387d6 rejected from java.util.concurrent.ThreadPoolExecutor@3b2a08[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 8]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:201)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1672238 T4486 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard3/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1672241 T4468 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:57571 57571
[junit4] 2> 1672878 T4469 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:57571 57571
[junit4] 2> 1672880 T4468 oas.SolrTestCaseJ4.tearDown ###Ending testShardAssignment
[junit4] 2> 1672880 T4482 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:57571_solr
[junit4] 2> 1672882 T4491 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 1672885 T4468 oas.SolrTestCaseJ4.setUp ###Starting testStateChange
[junit4] 2> 1672885 T4468 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1672886 T4492 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1672986 T4468 oasc.ZkTestServer.run start zk server on port:41987
[junit4] 2> 1672987 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1672989 T4498 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1901345 name:ZooKeeperConnection Watcher:127.0.0.1:41987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1672989 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1672990 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1672991 T4500 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d18398 name:ZooKeeperConnection Watcher:127.0.0.1:41987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1672991 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1673001 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1673002 T4502 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1affb57 name:ZooKeeperConnection Watcher:127.0.0.1:41987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1673002 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1673002 T4468 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1673005 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1673006 T4468 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1673008 T4468 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1673009 T4468 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1673012 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1673013 T4504 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cc6522 name:ZooKeeperConnection Watcher:127.0.0.1:41987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1673013 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1673013 T4468 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1673015 T4468 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1673018 T4468 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:41987_solr
[junit4] 2> 1673018 T4468 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1673020 T4468 oasc.Overseer.start Overseer (id=92268298915741699-127.0.0.1:41987_solr-n_0000000000) starting
[junit4] 2> 1673021 T4468 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1673023 T4468 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1673024 T4468 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1673026 T4468 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1673028 T4468 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1673030 T4468 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1673033 T4506 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1673034 T4505 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1673035 T4468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1673036 T4505 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1673036 T4505 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 1673036 T4505 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1673038 T4507 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1673038 T4508 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1673086 T4468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1673088 T4507 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1673089 T4505 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1673090 T4505 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"active"}
[junit4] 2> 1673090 T4505 oasc.Overseer$ClusterStateUpdater.updateState node=core_node1 is already registered
[junit4] 2> 1673090 T4505 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1673192 T4508 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1673240 T4468 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41987 41987
[junit4] 2> 1673949 T4492 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41987 41987
[junit4] 2> 1673951 T4468 oas.SolrTestCaseJ4.tearDown ###Ending testStateChange
[junit4] 2> 1673952 T4505 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:41987_solr
[junit4] 2> 1673953 T4509 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 1673956 T4468 oas.SolrTestCaseJ4.setUp ###Starting testShardLeaderChange
[junit4] 2> 1673957 T4468 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1673958 T4510 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1674058 T4468 oasc.ZkTestServer.run start zk server on port:47869
[junit4] 2> 1674059 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1674063 T4516 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8aac35 name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1674064 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1674065 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1674066 T4518 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c321e7 name:ZooKeeperConnection Watcher:127.0.0.1:47869 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1674066 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1674069 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1674070 T4520 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31ef49 name:ZooKeeperConnection Watcher:127.0.0.1:47869 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1674071 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1674071 T4468 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1674075 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1674091 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1674091 T4521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1674093 T4524 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f55f38 name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1674093 T4525 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f3dd8 name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1674093 T4521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1674094 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1674094 T4521 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1674095 T4468 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1674097 T4521 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1674097 T4468 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1674100 T4468 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1674102 T4521 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:47869_solr
[junit4] 2> 1674102 T4521 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1674103 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 1674104 T4521 oasc.Overseer.start Overseer (id=92268298985996291-127.0.0.1:47869_solr-n_0000000000) starting
[junit4] 2> 1674105 T4521 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1674105 T4468 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1674107 T4521 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1674109 T4521 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1674110 T4521 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1674112 T4521 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1674113 T4521 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1674117 T4528 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1674117 T4521 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 1674117 T4527 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1674118 T4527 oasc.Overseer$ClusterStateUpdater.amILeader org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:602)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:207)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1674118 T4521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1674118 T4527 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=92268298985996291-127.0.0.1:47869_solr-n_0000000000) am no longer a leader.
[junit4] 2> 1674119 T4527 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:47869_solr
[junit4] 2> 1674119 T4530 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5cc9d name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1674119 T4521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1674120 T4531 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 1674120 T4528 oasc.OverseerCollectionProcessor.run ERROR Unable to prioritize overseer org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /roles.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:251)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:248)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:248)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.prioritizeOverseerNodes(OverseerCollectionProcessor.java:412)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:256)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1674121 T4521 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:47869_solr
[junit4] 2> 1674122 T4521 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1674123 T4521 oasc.Overseer.start Overseer (id=92268298985996293-127.0.0.1:47869_solr-n_0000000001) starting
[junit4] 2> 1674127 T4533 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1674128 T4532 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1674131 T4532 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1674132 T4532 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1674132 T4532 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 1674132 T4532 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1674134 T4534 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1674135 T4526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1674607 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1674613 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1674615 T4534 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1674616 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1674617 T4532 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1674619 T4532 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1674619 T4532 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1674620 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1674621 T4534 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1674622 T4536 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@670646 name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1674622 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1674623 T4468 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1674624 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 1674627 T4534 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1674627 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1674628 T4532 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1674628 T4532 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1674631 T4468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1674731 T4537 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1674731 T4526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1674832 T4468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1674834 T4534 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1674836 T4532 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1674836 T4532 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 1674837 T4532 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 1674837 T4532 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1674939 T4526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1674939 T4537 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1675335 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1675340 T4525 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@106de02 rejected from java.util.concurrent.ThreadPoolExecutor@1d9925a[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 5]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:201)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1675340 T4538 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1675341 T4537 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1675343 T4534 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1675344 T4532 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1675447 T4537 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1676839 T4526 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1676840 T4468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1676842 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1676843 T4540 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8705e4 name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1676843 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1676844 T4468 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1676846 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 1676850 T4534 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1676850 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1676851 T4532 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1676852 T4532 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1676852 T4532 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1676855 T4541 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1676856 T4534 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1676856 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1676857 T4532 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1676857 T4532 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1676859 T4534 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1676861 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1676862 T4543 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1204a01 name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1676862 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1676863 T4468 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1676864 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 1676867 T4534 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1676867 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1676868 T4532 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1676868 T4532 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1676870 T4468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1676930 T4521 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 1676932 T4521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1676933 T4546 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@102ffb4 name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1676933 T4521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1676933 T4532 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:47869_solr
[junit4] 2> 1676935 T4547 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 1676936 T4521 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:47869_solr
[junit4] 2> 1676936 T4521 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1676937 T4521 oasc.Overseer.start Overseer (id=92268298985996297-127.0.0.1:47869_solr-n_0000000002) starting
[junit4] 2> 1676942 T4549 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1676944 T4548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1676944 T4548 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 1676945 T4548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1676945 T4548 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1676945 T4541 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1676945 T4544 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1676947 T4548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1676947 T4548 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1676948 T4544 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1676948 T4541 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1676950 T4544 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1676950 T4541 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1676951 T4548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1676952 T4548 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1676952 T4544 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1676952 T4541 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1676954 T4548 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1677072 T4468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1677074 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1677074 T4550 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1677076 T4548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1677076 T4548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 1677076 T4548 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1677079 T4551 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1677079 T4544 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1677082 T4550 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1677184 T4544 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1678579 T4541 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1678582 T4468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1678585 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1678586 T4553 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bbbe1 name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1678586 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1678588 T4468 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1678591 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 1678596 T4550 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1678596 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1678597 T4548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1678598 T4548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1678598 T4548 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1678601 T4554 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1678601 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1678602 T4550 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1678602 T4548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1678603 T4548 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1678605 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1678605 T4556 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cfedaf name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1678606 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1678606 T4550 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1678606 T4554 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1678606 T4468 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1678608 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 1678611 T4550 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1678611 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1678611 T4548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1678612 T4548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1678612 T4548 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1678614 T4468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1678616 T4550 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1678616 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1678617 T4548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 1678617 T4548 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1678621 T4558 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1678621 T4557 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1678624 T4550 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1678643 T4521 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 1678645 T4521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1678646 T4560 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14af7ed name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1678647 T4521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1678647 T4548 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:47869_solr
[junit4] 2> 1678648 T4561 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 1678650 T4521 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:47869_solr
[junit4] 2> 1678650 T4521 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1678652 T4521 oasc.Overseer.start Overseer (id=92268298985996300-127.0.0.1:47869_solr-n_0000000003) starting
[junit4] 2> 1678656 T4563 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1678658 T4562 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1678658 T4562 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 1678659 T4562 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1678659 T4562 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1678659 T4557 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1678661 T4562 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 1678661 T4562 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1678661 T4557 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1678663 T4557 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1678664 T4562 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1680121 T4554 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1680122 T4468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1680124 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1680125 T4565 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44698a name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1680125 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1680126 T4468 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1680128 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 1680132 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1680132 T4567 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1680134 T4562 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1680134 T4562 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1680135 T4562 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1680138 T4566 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1680138 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1680139 T4567 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1680139 T4562 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1680140 T4562 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1680142 T4468 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1680143 T4569 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@da5423 name:ZooKeeperConnection Watcher:127.0.0.1:47869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1680143 T4468 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1680143 T4567 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1680144 T4566 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1680144 T4468 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1680146 T4468 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 1680148 T4567 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1680148 T4468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1680149 T4562 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1680149 T4562 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1680149 T4562 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1680151 T4468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1680153 T4567 oasc.DistributedQueue$LatchChildWatcher.process Latc
[...truncated too long message...]
Path(SolrZkClient.java:442)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:411)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:398)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:136)
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:131)
[junit4] 2> ... 10 more
[junit4] 2>
[junit4] 2> 1737161 T5075 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard13
[junit4] 2> 1737163 T4839 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x147cd883868004c, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1737165 T5078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard11
[junit4] 2> 1738665 T5075 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:144)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leaders/shard13
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:457)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:454)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:411)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:398)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:136)
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:131)
[junit4] 2> ... 10 more
[junit4] 2>
[junit4] 2> 1738671 T4468 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:45495 45495
[junit4] 2> 1739500 T4838 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:45495 45495
[junit4] 2> 1739506 T4468 oas.SolrTestCaseJ4.tearDown ###Ending testShardAssignmentBigger
[junit4] 2> 1739506 T4851 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:45495_solr
[junit4] 2> 1739507 T5212 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 1742508 T4468 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.OverseerTest-6641C8D44BE5DD9F-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene49), sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_SD, timezone=MST
[junit4] 2> NOTE: Linux 3.13.0-32-generic i386/Oracle Corporation 1.7.0_65 (32-bit)/cpus=8,threads=1,free=117133880,total=395411456
[junit4] 2> NOTE: All tests run in this JVM: [PathHierarchyTokenizerFactoryTest, TestInitQParser, DocValuesMultiTest, TestSolrXmlPersistence, TimeZoneUtilsTest, TestSolrIndexConfig, TestConfig, DisMaxRequestHandlerTest, CustomCollectionTest, FileUtilsTest, SuggesterTest, ClusterStateUpdateTest, DirectSolrSpellCheckerTest, TestLMDirichletSimilarityFactory, TestStandardQParsers, AnalyticsMergeStrategyTest, TestCoreDiscovery, TestHashPartitioner, TestNoOpRegenerator, TestFaceting, TestDynamicFieldCollectionResource, BadComponentTest, PingRequestHandlerTest, TestLRUCache, TestArbitraryIndexDir, TestChildDocTransformer, SyncSliceTest, TestDocBasedVersionConstraints, OverseerCollectionProcessorTest, EchoParamsTest, TermsComponentTest, TestComplexPhraseQParserPlugin, TestBinaryResponseWriter, TestRequestStatusCollectionAPI, TestFoldingMultitermQuery, TestDocSet, SystemInfoHandlerTest, ZkCLITest, TestAnalyzedSuggestions, ResponseLogComponentTest, TestLuceneMatchVersion, SolrIndexSplitterTest, SSLMigrationTest, SuggesterTSTTest, TestFieldTypeResource, TestSolr4Spatial, AddSchemaFieldsUpdateProcessorFactoryTest, BadIndexSchemaTest, PrimitiveFieldTypeTest, SolrCmdDistributorTest, SpellCheckCollatorTest, TestManagedStopFilterFactory, ReplicationFactorTest, HdfsSyncSliceTest, FunctionTest, ResponseHeaderTest, RecoveryZkTest, HighlighterTest, TestDFRSimilarityFactory, TestSolrCoreProperties, TestDocumentBuilder, TestFastWriter, FastVectorHighlighterTest, TestSchemaResource, TestManagedSynonymFilterFactory, SolrXmlInZkTest, TestClassNameShortening, ParsingFieldUpdateProcessorsTest, HdfsWriteToMultipleCollectionsTest, WordBreakSolrSpellCheckerTest, FieldMutatingUpdateProcessorTest, OverseerStatusTest, SuggesterWFSTTest, HighlighterMaxOffsetTest, TestIntervalFaceting, TestSearcherReuse, TestManagedResourceStorage, TestSort, IndexSchemaTest, TestAnalyzeInfixSuggestions, TestCodecSupport, XmlUpdateRequestHandlerTest, OpenExchangeRatesOrgProviderTest, ChaosMonkeyNothingIsSafeTest, CursorMarkTest, AssignTest, DirectUpdateHandlerTest, SpellCheckComponentTest, QueryResultKeyTest, TestReplicationHandler, TestStressRecovery, PreAnalyzedUpdateProcessorTest, ZkControllerTest, TestFieldResource, MinimalSchemaTest, TestRandomDVFaceting, AddBlockUpdateTest, PluginInfoTest, ExternalFileFieldSortTest, FieldFacetTest, TestSolrDeletionPolicy1, RegexBoostProcessorTest, TestTolerantSearch, BasicDistributedZkTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OverseerTest]
[junit4] Completed on J0 in 75.05s, 9 tests, 1 error <<< FAILURES!
[...truncated 661 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:474: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:454: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1307: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 421 suites, 1761 tests, 1 error, 39 ignored (18 assumptions)
Total time: 102 minutes 51 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_65 -client -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any