You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/04/17 21:10:57 UTC
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_60-ea-b14) -
Build # 3880 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3880/
Java: 32bit/jdk1.7.0_60-ea-b14 -client -XX:+UseG1GC
1 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([C59EE80C751EE9EE:C19667FF67BB06CF]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:136)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:134)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:134)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:661)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:123)
... 47 more
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:128)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
... 48 more
Build Log:
[...truncated 11244 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.OverseerTest-C59EE80C751EE9EE-001\init-core-data-001
[junit4] 2> 1725380 T5692 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1725380 T5692 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 1725380 T5692 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 1725383 T5692 oas.SolrTestCaseJ4.setUp ###Starting testBadQueueItem
[junit4] 2> 1725385 T5692 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1725385 T5693 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1725472 T5692 oasc.ZkTestServer.run start zk server on port:52064
[junit4] 2> 1725475 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1725485 T5699 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@acfb78 name:ZooKeeperConnection Watcher:127.0.0.1:52064 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1725485 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1725491 T5694 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14570f5d5020000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1725494 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1725499 T5701 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f6cd name:ZooKeeperConnection Watcher:127.0.0.1:52064 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1725499 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1725499 T5692 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1725512 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1725516 T5703 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48b999 name:ZooKeeperConnection Watcher:127.0.0.1:52064/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1725516 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1725516 T5692 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1725525 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1725529 T5705 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54e391 name:ZooKeeperConnection Watcher:127.0.0.1:52064/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1725530 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1725532 T5692 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1725539 T5692 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1725549 T5692 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52064_solr
[junit4] 2> 1725549 T5692 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1725555 T5692 oasc.Overseer.start Overseer (id=91603568573939715-127.0.0.1:52064_solr-n_0000000000) starting
[junit4] 2> 1725561 T5692 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1725572 T5692 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1725576 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1725580 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1725585 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1725590 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1725598 T5707 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1725599 T5692 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1725600 T5707 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:52064_solr
[junit4] 2> 1725601 T5706 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1725602 T5692 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1725604 T5692 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1725608 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1725611 T5709 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a13c64 name:ZooKeeperConnection Watcher:127.0.0.1:52064/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1725611 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1725613 T5692 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1725617 T5692 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1
[junit4] 2> 1725621 T5709 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 1725621 T5703 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 1725624 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1725627 T5706 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1725628 T5706 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1725629 T5706 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 1725629 T5706 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1725634 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1725636 T5703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1725636 T5709 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1726058 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1726089 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1726109 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1726114 T5706 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1726117 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1726128 T5706 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1726129 T5706 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1726129 T5706 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1726138 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1726231 T5703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1726231 T5709 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1726550 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1726569 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1726583 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1726583 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1726583 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1726584 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1726586 T5706 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1726594 T5706 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1726594 T5706 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1726594 T5706 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1726599 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1726689 T5709 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1726689 T5703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1727017 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 1727039 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 1727055 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727055 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727056 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727061 T5706 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1727070 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727164 T5709 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1727164 T5703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1727196 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727196 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727197 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727203 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727204 T5706 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1727207 T5706 oasc.Overseer$ClusterStateUpdater.checkKeyExistence ERROR Skipping invalid Overseer message because it has no collection specified: {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core0",
[junit4] 2> "core_node_name":"node0",
[junit4] 2> "collection":"",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1727218 T5706 oasc.Overseer$ClusterStateUpdater.checkKeyExistence ERROR Skipping invalid Overseer message because it has no collection specified: {
[junit4] 2> "operation":"deletecore",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core0",
[junit4] 2> "core_node_name":"node0",
[junit4] 2> "collection":""}
[junit4] 2> 1727226 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727229 T5706 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1727229 T5706 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection2 with shards [shard1, shard2, shard3]
[junit4] 2> 1727230 T5706 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1727238 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727331 T5709 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1727332 T5703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1727642 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard1/election
[junit4] 2> 1727670 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard1
[junit4] 2> 1727687 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727687 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727688 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727695 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727695 T5706 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1727707 T5706 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1727708 T5706 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1727708 T5706 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1727717 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1727810 T5703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1727811 T5709 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1728127 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard2/election
[junit4] 2> 1728149 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard2
[junit4] 2> 1728164 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1728164 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1728165 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1728169 T5706 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1728171 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1728183 T5706 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1728183 T5706 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1728184 T5706 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1728192 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1728282 T5709 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1728283 T5703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1728603 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard3/election
[junit4] 2> 1728614 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard3
[junit4] 2> 1728622 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1728623 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1728623 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1728624 T5706 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1728629 T5705 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1728723 T5703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1728724 T5709 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1728755 T5694 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14570f5d5020002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1728758 T5709 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 1728758 T5694 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14570f5d5020004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1728762 T5692 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52064 52064
[junit4] 2> 1730787 T5693 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52064 52064
[junit4] 2> 1730789 T5692 oas.SolrTestCaseJ4.tearDown ###Ending testBadQueueItem
[junit4] 2> 1730790 T5706 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:52064_solr
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1730792 T5710 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:302)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:291)
[junit4] 2>
[junit4] 2> 1730796 T5692 oas.SolrTestCaseJ4.setUp ###Starting testPlaceholders
[junit4] 2> 1730797 T5692 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1730797 T5711 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1730893 T5692 oasc.ZkTestServer.run start zk server on port:52082
[junit4] 2> 1730894 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1730900 T5717 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f2eb7 name:ZooKeeperConnection Watcher:127.0.0.1:52082/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1730900 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1730901 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1730903 T5719 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@181759c name:ZooKeeperConnection Watcher:127.0.0.1:52082 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1730903 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1730906 T5712 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14570f5ea260001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1730907 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1730909 T5721 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@103d944 name:ZooKeeperConnection Watcher:127.0.0.1:52082 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1730910 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1730910 T5692 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1730914 T5692 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1730918 T5692 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1730921 T5692 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1730925 T5692 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1730928 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1730930 T5723 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@599830 name:ZooKeeperConnection Watcher:127.0.0.1:52082/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1730930 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1730932 T5692 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1730936 T5692 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 1730940 T5717 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 1730940 T5723 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 1730941 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1730943 T5725 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cdc31b name:ZooKeeperConnection Watcher:127.0.0.1:52082/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1730943 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1730944 T5692 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1730947 T5692 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1730954 T5692 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52082_solr
[junit4] 2> 1730954 T5692 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1730957 T5692 oasc.Overseer.start Overseer (id=91603568928620548-127.0.0.1:52082_solr-n_0000000000) starting
[junit4] 2> 1730961 T5692 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1730966 T5692 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1730970 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1730975 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1730980 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1730985 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1730994 T5727 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1730996 T5727 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:52082_solr
[junit4] 2> 1730996 T5726 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1731000 T5726 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1731001 T5726 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=12 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"12",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1731001 T5726 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8, shard9, shard10, shard11, shard12]
[junit4] 2> 1731002 T5726 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard12
[junit4] 2> 1731006 T5725 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1731006 T5723 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1731007 T5717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1731474 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard12/election
[junit4] 2> 1731502 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard12
[junit4] 2> 1731525 T5725 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1731526 T5692 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1731531 T5726 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1731539 T5723 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 1731540 T5717 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 1731541 T5712 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14570f5ea260003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1731545 T5692 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52082 52082
[junit4] 2> 1732958 T5726 oasc.Overseer$ClusterStateUpdater.run WARN Solr cannot talk to ZK, exiting Overseer main queue loop org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ClusterState.load(ClusterState.java:239)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:422)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:240)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:233)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1733689 T5726 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:52082_solr
[junit4] 2> 1733689 T5711 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52082 52082
[junit4] 2> 1733690 T5728 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:302)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:291)
[junit4] 2>
[junit4] 2> 1733691 T5692 oas.SolrTestCaseJ4.tearDown ###Ending testPlaceholders
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1733700 T5692 oas.SolrTestCaseJ4.setUp ###Starting testReplay
[junit4] 2> 1733702 T5692 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1733703 T5729 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1733799 T5692 oasc.ZkTestServer.run start zk server on port:52100
[junit4] 2> 1733801 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1733808 T5735 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@480243 name:ZooKeeperConnection Watcher:127.0.0.1:52100/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1733808 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1733810 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1733813 T5737 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d91957 name:ZooKeeperConnection Watcher:127.0.0.1:52100 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1733813 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1733817 T5730 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14570f5f5830001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1733817 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1733820 T5739 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@179a9df name:ZooKeeperConnection Watcher:127.0.0.1:52100 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1733820 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1733820 T5692 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1733826 T5692 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1733827 T5730 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14570f5f5830002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1733832 T5692 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1733835 T5692 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1733839 T5692 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1733845 T5692 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1733855 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1733857 T5741 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a12e80 name:ZooKeeperConnection Watcher:127.0.0.1:52100/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1733858 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1733858 T5692 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1733861 T5692 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1733869 T5692 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52100_solr
[junit4] 2> 1733870 T5692 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1733872 T5692 oasc.Overseer.start Overseer (id=91603569119264771-127.0.0.1:52100_solr-n_0000000000) starting
[junit4] 2> 1733876 T5692 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1733884 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1733890 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1733895 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1733899 T5692 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1733909 T5743 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1733910 T5743 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:52100_solr
[junit4] 2> 1733912 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1733913 T5742 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 1733914 T5742 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 1733916 T5735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1733922 T5742 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core2",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 1733923 T5735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1733928 T5742 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1733931 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1733933 T5742 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core3",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 1733937 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1733939 T5735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1734010 T5730 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14570f5f5830003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1734014 T5692 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52100 52100
[junit4] 2> 1736155 T5729 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52100 52100
[junit4] 2> 1736158 T5692 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4] 2> 1736158 T5742 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:52100_solr
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1736160 T5744 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:302)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:291)
[junit4] 2>
[junit4] 2> 1736164 T5692 oas.SolrTestCaseJ4.setUp ###Starting testShardLeaderChange
[junit4] 2> 1736167 T5692 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1736168 T5745 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1736263 T5692 oasc.ZkTestServer.run start zk server on port:52115
[junit4] 2> 1736267 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1736278 T5751 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a124f1 name:ZooKeeperConnection Watcher:127.0.0.1:52115/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1736279 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1736282 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1736284 T5753 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b71189 name:ZooKeeperConnection Watcher:127.0.0.1:52115 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1736284 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1736289 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1736292 T5755 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1407bf8 name:ZooKeeperConnection Watcher:127.0.0.1:52115 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1736292 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1736292 T5692 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1736297 T5692 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1736309 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1736310 T5756 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1736312 T5758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@487176 name:ZooKeeperConnection Watcher:127.0.0.1:52115/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1736313 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1736313 T5760 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11359e name:ZooKeeperConnection Watcher:127.0.0.1:52115/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1736314 T5692 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1736314 T5756 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1736317 T5756 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1736318 T5692 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1736321 T5692 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1736321 T5756 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1736326 T5692 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 1736331 T5756 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52115_solr
[junit4] 2> 1736331 T5756 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1736333 T5758 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 1736333 T5692 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1736335 T5756 oasc.Overseer.start Overseer (id=91603569280614404-127.0.0.1:52115_solr-n_0000000000) starting
[junit4] 2> 1736341 T5756 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1736346 T5756 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1736352 T5756 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1736357 T5756 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1736366 T5756 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1736379 T5756 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 1736380 T5762 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1736384 T5756 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1736386 T5764 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aa8262 name:ZooKeeperConnection Watcher:127.0.0.1:52115/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1736387 T5756 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1736388 T5762 oasc.OverseerCollectionProcessor.amILeader According to ZK I (id=91603569280614404-127.0.0.1:52115_solr-n_0000000000) am no longer a leader.
[junit4] 2> 1736389 T5762 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:52115_solr
[junit4] 2> 1736389 T5762 oasc.OverseerCollectionProcessor.run ERROR Unable to prioritize overseer org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /roles.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:226)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:223)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:223)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.prioritizeOverseerNodes(OverseerCollectionProcessor.java:299)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:212)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1736398 T5756 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52115_solr
[junit4] 2> 1736398 T5756 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1736400 T5756 oasc.Overseer.start Overseer (id=91603569280614405-127.0.0.1:52115_solr-n_0000000001) starting
[junit4] 2> 1736419 T5766 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1736421 T5766 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:52115_solr
[junit4] 2> 1736422 T5765 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1736425 T5765 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1736426 T5765 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1736426 T5765 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 1736426 T5765 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1736431 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1736433 T5758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1736816 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1736830 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1736837 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1736841 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1736841 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1736841 T5765 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1736849 T5765 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1736849 T5765 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1736850 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1736852 T5768 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13ec6f6 name:ZooKeeperConnection Watcher:127.0.0.1:52115/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1736853 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1736854 T5692 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1736855 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1736857 T5692 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 1736863 T5768 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1736863 T5758 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1736867 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1736867 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1736868 T5765 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1736868 T5765 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1736874 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1736877 T5692 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1736974 T5768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1736974 T5758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1737069 T5692 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1737075 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737076 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737076 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737080 T5765 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1737081 T5765 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 1737081 T5765 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 1737081 T5765 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1737087 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737186 T5768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1737186 T5758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1737551 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1737566 T5768 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 1737567 T5746 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14570f5ff210003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1737566 T5758 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 1737568 T5758 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1737569 T5758 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1737569 T5692 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1737570 T5768 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1737584 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737584 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737585 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737588 T5765 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1737608 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737707 T5768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1737762 T5692 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1737766 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1737768 T5770 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e9d9aa name:ZooKeeperConnection Watcher:127.0.0.1:52115/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1737769 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1737771 T5692 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1737780 T5692 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 1737789 T5768 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1737790 T5770 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1737795 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737796 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737795 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1737796 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737800 T5765 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1737802 T5765 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1737803 T5765 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1737812 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737818 T5746 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14570f5ff210006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1737818 T5770 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 1737822 T5770 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1737823 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737824 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1737826 T5765 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1737826 T5765 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1737847 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737851 T5764 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1737854 T5756 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 1737856 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1737862 T5756 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1737863 T5772 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f9e9c5 name:ZooKeeperConnection Watcher:127.0.0.1:52115/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1737864 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1737866 T5774 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b588b9 name:ZooKeeperConnection Watcher:127.0.0.1:52115/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1737867 T5692 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1737867 T5756 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1737870 T5765 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:52115_solr
[junit4] 2> 1737874 T5775 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:302)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:291)
[junit4] 2>
[junit4] 2> 1737883 T5692 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 1737887 T5756 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52115_solr
[junit4] 2> 1737889 T5756 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1737891 T5772 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1737892 T5770 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1737909 T5756 oasc.Overseer.start Overseer (id=91603569280614409-127.0.0.1:52115_solr-n_0000000002) starting
[junit4] 2> 1737914 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1737939 T5692 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1737953 T5777 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1737956 T5777 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:52115_solr
[junit4] 2> 1737959 T5776 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1737961 T5776 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 1737962 T5776 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1737963 T5776 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1737966 T5772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1737966 T5770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1737978 T5776 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1737978 T5776 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1737982 T5770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1737983 T5772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1737988 T5776 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1737993 T5776 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1738001 T5774 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1738003 T5772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1738003 T5770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1738013 T5776 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1738015 T5776 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1738015 T5776 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1738022 T5774 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1738121 T5772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1738121 T5770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1738133 T5692 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1738141 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1738141 T5774 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1738143 T5774 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1738143 T5774 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1738148 T5776 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1738150 T5776 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 1738151 T5776 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 1738162 T5746 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14570f5ff210007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1738162 T5774 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1738163 T5772 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 1738163 T5692 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1738166 T5772 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1738177 T5774 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1738184 T5774 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1738285 T5772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1738355 T5692 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1738359 T5692 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1738363 T5779 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9e9faa name:ZooKeeperConnection Watcher:127.0.0.1:52115/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1738364 T5692 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1738365 T5692 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1738369 T5692 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 1738376 T5772 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1738380 T5779 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1738382 T5692 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1738382 T5774 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1738383 T5774 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type Nod
[...truncated too long message...]
2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:123)
[junit4] 2> ... 6 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:209)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:417)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:128)
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
[junit4] 2> ... 7 more
[junit4] 2>
[junit4] 2> 1785355 T5874 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52241 52241
[junit4] 2> 1785365 T6070 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1785368 T5692 oas.SolrTestCaseJ4.tearDown ###Ending testShardAssignmentBigger
[junit4] 2> 1785368 T5887 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:52241_solr
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1785370 T5692 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 1785371 T6162 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:302)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:291)
[junit4] 2>
[junit4] 2> 1785371 T5692 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 1787889 T5692 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.OverseerTest-C59EE80C751EE9EE-001
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=de_LU, timezone=America/Edmonton
[junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=2,threads=1,free=141996408,total=402653184
[junit4] 2> NOTE: All tests run in this JVM: [TestFreeTextSuggestions, TestUtils, TestHighlightDedupGrouping, TestSolrXMLSerializer, TestDefaultSimilarityFactory, SignatureUpdateProcessorFactoryTest, TestBlendedInfixSuggestions, HighlighterTest, TestQuerySenderListener, TestLMDirichletSimilarityFactory, ShardRoutingCustomTest, ClusterStateTest, MultiTermTest, ShowFileRequestHandlerTest, TestSearcherReuse, ShardSplitTest, TestRangeQuery, SuggesterTest, SampleTest, NumericFieldsTest, TestStressLucene, HdfsBasicDistributedZk2Test, TestSolrCoreProperties, TestSchemaSimilarityResource, ReturnFieldsTest, TestManagedResourceStorage, TestXIncludeConfig, TestCollationField, TestExpandComponent, StatsComponentTest, TestMergePolicyConfig, JSONWriterTest, DistributedQueryComponentCustomSortTest, SpellCheckCollatorTest, TestSolr4Spatial, TestExtendedDismaxParser, TestStandardQParsers, SyncSliceTest, DistanceFunctionTest, OpenExchangeRatesOrgProviderTest, SolrIndexSplitterTest, TestCoreDiscovery, SliceStateTest, TestLRUCache, UUIDFieldTest, TestSolrDeletionPolicy1, DirectUpdateHandlerTest, TestNoOpRegenerator, TestAddFieldRealTimeGet, QueryParsingTest, ConnectionManagerTest, CoreAdminCreateDiscoverTest, TestTrie, TestQueryUtils, CollectionsAPIAsyncDistributedZkTest, TestMiniSolrCloudCluster, SpellingQueryConverterTest, TestPHPSerializedResponseWriter, BinaryUpdateRequestHandlerTest, DateFieldTest, SolrRequestParserTest, TestPostingsSolrHighlighter, TestNRTOpen, TestFunctionQuery, HdfsChaosMonkeySafeLeaderTest, TestSchemaVersionResource, DistributedTermsComponentTest, TestValueSourceCache, SolrIndexConfigTest, ScriptEngineTest, TestComplexPhraseQParserPlugin, LegacyHTMLStripCharFilterTest, TestSolrXmlPersistor, SliceStateUpdateTest, SimplePostToolTest, TestSolrQueryParserResource, ChaosMonkeySafeLeaderTest, TestDFRSimilarityFactory, TestUniqueKeyFieldResource, TestInitQParser, TestCustomSort, TestFieldTypeResource, XsltUpdateRequestHandlerTest, TestRealTimeGet, TestDefaultSearchFieldResource, JsonLoaderTest, TestPartialUpdateDeduplication, TestSuggestSpellingConverter, RegexBoostProcessorTest, SchemaVersionSpecificBehaviorTest, ZkControllerTest, TriLevelCompositeIdRoutingTest, RequestHandlersTest, TestDynamicFieldCollectionResource, DisMaxRequestHandlerTest, HdfsUnloadDistributedZkTest, TestCSVResponseWriter, QueryEqualityTest, SuggestComponentTest, BadCopyFieldTest, BJQParserTest, NoCacheHeaderTest, TestRequestStatusCollectionAPI, TestExceedMaxTermLength, SuggesterWFSTTest, PluginInfoTest, SystemInfoHandlerTest, TestCopyFieldCollectionResource, IndexSchemaRuntimeFieldTest, BasicZkTest, CursorPagingTest, SortByFunctionTest, PolyFieldTest, TestRandomMergePolicy, TestLMJelinekMercerSimilarityFactory, HdfsSyncSliceTest, CursorMarkTest, TestCollectionAPI, ShardRoutingTest, SolrCmdDistributorTest, SpellCheckComponentTest, TestBinaryResponseWriter, TestJoin, DistribCursorPagingTest, TestOverriddenPrefixQueryForCustomFieldType, DOMUtilTest, TestConfigSets, TestPerFieldSimilarity, SolrInfoMBeanTest, SOLR749Test, DeleteInactiveReplicaTest, SuggesterTSTTest, BasicDistributedZkTest, TestStressRecovery, TestFastOutputStream, ZkCLITest, DocumentAnalysisRequestHandlerTest, PreAnalyzedFieldTest, TestClassNameShortening, BasicDistributedZk2Test, TestSerializedLuceneMatchVersion, DocValuesMultiTest, HdfsCollectionsAPIDistributedZkTest, NotRequiredUniqueKeyTest, QueryResultKeyTest, TestReplicationHandler, TestStressReorder, StressHdfsTest, TestBadConfig, TestSchemaNameResource, TestShortCircuitedRequests, TestSolrDeletionPolicy2, ExternalFileFieldSortTest, TestSolrIndexConfig, TestManagedStopFilterFactory, AutoCommitTest, DistributedSpellCheckComponentTest, FieldMutatingUpdateProcessorTest, TestCloudManagedSchemaAddField, PingRequestHandlerTest, CSVRequestHandlerTest, TestDistribDocBasedVersion, SimpleFacetsTest, TermsComponentTest, TestFoldingMultitermQuery, ParsingFieldUpdateProcessorsTest, TestManagedResource, DistributedExpandComponentTest, TestIBSimilarityFactory, OverseerTest]
[junit4] Completed in 62.54s, 9 tests, 1 error <<< FAILURES!
[...truncated 666 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1297: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:921: There were test failures: 387 suites, 1619 tests, 1 error, 42 ignored (21 assumptions)
Total time: 96 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60-ea-b14 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure