You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/02/12 12:02:33 UTC

[JENKINS] Lucene » Lucene-Solr-BadApples-Tests-8.x - Build # 188 - Unstable!

Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-BadApples-Tests-8.x/188/

1 tests failed.
FAILED:  org.apache.solr.cloud.OverseerTest.testShardLeaderChange

Error Message:
Captured an uncaught exception in thread: Thread[id=13052, name=OverseerCollectionConfigSetProcessor-72986521681920015-127.0.0.1:44629_solr-n_0000000000, state=RUNNABLE, group=Overseer collection creation process.]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=13052, name=OverseerCollectionConfigSetProcessor-72986521681920015-127.0.0.1:44629_solr-n_0000000000, state=RUNNABLE, group=Overseer collection creation process.]
	at __randomizedtesting.SeedInfo.seed([9FE226E1AF235945:41B1A116B5BBACB4]:0)
Caused by: org.apache.solr.common.AlreadyClosedException
	at __randomizedtesting.SeedInfo.seed([9FE226E1AF235945]:0)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:77)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:351)
	at org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:442)
	at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:161)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13679 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> 321445 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-BadApples-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 321445 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-BadApples-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.OverseerTest_9FE226E1AF235945-001/data-dir-36-001
   [junit4]   2> 321445 WARN  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 321445 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 321447 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 321447 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 321448 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 321459 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 321459 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 321459 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 321548 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 44629
   [junit4]   2> 321548 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:44629
   [junit4]   2> 321548 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:44629
   [junit4]   2> 321548 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 44629
   [junit4]   2> 321549 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 321551 INFO  (zkConnectionManagerCallback-2433-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 321551 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 321554 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 321555 INFO  (zkConnectionManagerCallback-2435-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 321556 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 321556 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 321556 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 321564 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testReplay
   [junit4]   2> 321627 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 321628 INFO  (zkConnectionManagerCallback-2439-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 321628 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 321631 WARN  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@25e62d0b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 321631 WARN  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@25e62d0b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 321632 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 321633 WARN  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@41ab4982[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 321633 WARN  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@41ab4982[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 321694 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 321696 INFO  (zkConnectionManagerCallback-2448-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 321696 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 321750 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 321751 INFO  (zkConnectionManagerCallback-2453-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 321751 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 321753 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44629/solr ready
   [junit4]   2> 321755 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44629_solr
   [junit4]   2> 321756 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Overseer (id=72986521681920002-127.0.0.1:44629_solr-n_0000000000) starting
   [junit4]   2> 321763 WARN  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
   [junit4]   2> 321764 INFO  (OverseerStateUpdate-72986521681920002-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44629_solr
   [junit4]   2> 321765 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 322184 INFO  (closeThreadPool-2459-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72986521681920002-127.0.0.1:44629_solr-n_0000000000) closing
   [junit4]   2> 322185 INFO  (OverseerStateUpdate-72986521681920002-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer According to ZK I (id=72986521681920002-127.0.0.1:44629_solr-n_0000000000) am no longer a leader. propsId=null
   [junit4]   2> 322186 INFO  (OverseerAutoScalingTriggerThread-72986521681920002-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 322186 INFO  (OverseerStateUpdate-72986521681920002-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44629_solr
   [junit4]   2> 322194 WARN  (OverseerExitThread) [     ] o.a.s.c.Overseer Error communicating with ZooKeeper
   [junit4]   2>           => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2358) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:351) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:79) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:351) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:350) ~[java/:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> 322229 INFO  (TEST-OverseerTest.testReplay-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testReplay
   [junit4]   2> 322234 INFO  (TEST-OverseerTest.testLatchWatcher-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testLatchWatcher
   [junit4]   2> 322337 INFO  (TEST-OverseerTest.testLatchWatcher-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testLatchWatcher
   [junit4]   2> 322343 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testExternalClusterStateChangeBehavior
   [junit4]   2> 322396 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 322397 INFO  (zkConnectionManagerCallback-2465-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 322397 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 322399 WARN  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@41fdc796[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 322399 WARN  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@41fdc796[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 322400 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 322400 WARN  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@84bb8cf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 322400 WARN  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@84bb8cf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 322401 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 322402 INFO  (zkConnectionManagerCallback-2474-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 322402 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 322405 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 322405 INFO  (zkConnectionManagerCallback-2479-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 322405 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 322407 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44629/solr ready
   [junit4]   2> 322409 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44629_solr
   [junit4]   2> 322410 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Overseer (id=72986521681920005-127.0.0.1:44629_solr-n_0000000000) starting
   [junit4]   2> 322416 WARN  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
   [junit4]   2> 322418 INFO  (OverseerStateUpdate-72986521681920005-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44629_solr
   [junit4]   2> 322420 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/c1/state.json is deleted, stop watching children
   [junit4]   2> 322423 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/c1/state.json is deleted, stop watching children
   [junit4]   2> 322424 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (c1) shard=shard1 coreNodeName=core_node1
   [junit4]   2> 322425 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/c1/state.json is deleted, stop watching children
   [junit4]   2> 322533 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/test/state.json is deleted, stop watching children
   [junit4]   2> 322534 INFO  (OverseerStateUpdate-72986521681920005-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"test",
   [junit4]   2>   "shard":"x",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "node_name":"127.0.0.1:8983_solr",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"down"} 
   [junit4]   2> 322635 INFO  (zkCallback-2434-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 322635 ERROR (OverseerStateUpdate-72986521681920005-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Exception in Overseer main queue loop
   [junit4]   2>           => org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /clusterstate.json
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:122)
   [junit4]   2> org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /clusterstate.json
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:122) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:2561) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$7(SolrZkClient.java:363) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:79) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:363) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:281) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:207) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:276) [java/:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> 322639 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (test) shard=x coreNodeName=core_node1
   [junit4]   2> 322640 WARN  (OverseerStateUpdate-72986521681920005-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.o.ClusterStateMutator Collection test already exists. exit
   [junit4]   2> 322641 ERROR (OverseerStateUpdate-72986521681920005-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.o.CollectionMutator Unable to create Shard: x because it already exists in collection: test
   [junit4]   2> 322641 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/c1/state.json is deleted, stop watching children
   [junit4]   2> 322642 INFO  (OverseerStateUpdate-72986521681920005-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"test",
   [junit4]   2>   "shard":"x",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "node_name":"127.0.0.1:8983_solr",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"down"} 
   [junit4]   2> 322642 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (c1) shard=shard1 coreNodeName=core_node1
   [junit4]   2> 322642 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/c1/state.json is deleted, stop watching children
   [junit4]   2> 322948 INFO  (closeThreadPool-2485-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72986521681920005-127.0.0.1:44629_solr-n_0000000000) closing
   [junit4]   2> 322949 INFO  (OverseerStateUpdate-72986521681920005-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44629_solr
   [junit4]   2> 322949 INFO  (OverseerAutoScalingTriggerThread-72986521681920005-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 322953 WARN  (OverseerExitThread) [     ] o.a.s.c.Overseer Error communicating with ZooKeeper
   [junit4]   2>           => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2358) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:351) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:79) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:351) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:350) ~[java/:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> 322980 INFO  (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testExternalClusterStateChangeBehavior
   [junit4]   2> 322986 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testShardAssignment
   [junit4]   2> 323039 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 323040 INFO  (zkConnectionManagerCallback-2487-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 323040 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 323046 WARN  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@36ba9dd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 323046 WARN  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@36ba9dd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 323047 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 323047 WARN  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2fdbd9bc[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 323047 WARN  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2fdbd9bc[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 323050 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 323050 INFO  (zkConnectionManagerCallback-2496-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 323050 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 323054 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 323055 INFO  (zkConnectionManagerCallback-2501-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 323055 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 323057 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44629/solr ready
   [junit4]   2> 323059 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44629_solr
   [junit4]   2> 323060 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Overseer (id=72986521681920008-127.0.0.1:44629_solr-n_0000000000) starting
   [junit4]   2> 323071 INFO  (OverseerStateUpdate-72986521681920008-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44629_solr
   [junit4]   2> 323074 WARN  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
   [junit4]   2> 323082 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 323086 INFO  (zkConnectionManagerCallback-2509-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 323086 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 323091 INFO  (zkCallback-2434-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 323093 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 323102 INFO  (zkCallback-2508-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 323102 INFO  (zkCallback-2486-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 323106 INFO  (zkCallback-2500-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 323214 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
   [junit4]   2> 323216 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72986521681920011-127.0.0.1:8983_solrcore1-n_0000000000
   [junit4]   2> 323222 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 323325 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2
   [junit4]   2> 323326 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard2/leader after winning as /collections/collection1/leader_elect/shard2/election/72986521681920011-127.0.0.1:8983_solrcore2-n_0000000000
   [junit4]   2> 323329 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 323432 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard3
   [junit4]   2> 323434 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard3/leader after winning as /collections/collection1/leader_elect/shard3/election/72986521681920011-127.0.0.1:8983_solrcore3-n_0000000000
   [junit4]   2> 323436 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 323540 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
   [junit4]   2> 323543 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 323647 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2
   [junit4]   2> 323649 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 323753 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard3
   [junit4]   2> 323754 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 323766 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 323768 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 323768 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 323769 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
   [junit4]   2> 323769 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
   [junit4]   2> 323770 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
   [junit4]   2> 323771 WARN  (zkCallback-2508-thread-1) [     ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
   [junit4]   2> 323771 WARN  (zkCallback-2508-thread-1) [     ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
   [junit4]   2> 323772 WARN  (zkCallback-2508-thread-1) [     ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
   [junit4]   2> 323773 INFO  (zkCallback-2500-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 323773 INFO  (zkCallback-2434-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 323773 INFO  (zkCallback-2508-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 323778 INFO  (zkCallback-2486-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 323778 WARN  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]-SendThread(127.0.0.1:44629)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1034cdad23e000b.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1034cdad23e000b, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1034cdad23e000b, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 323995 WARN  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]-SendThread(127.0.0.1:44629)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1034cdad23e0009.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1034cdad23e0009, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1034cdad23e0009, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 324098 WARN  (NIOWorkerThread-4) [     ] o.a.z.s.NIOServerCnxn Unexpected exception
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /127.0.0.1:60078, session = 0x1034cdad23e000a
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:163)
   [junit4]   2> org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /127.0.0.1:60078, session = 0x1034cdad23e000a
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:163) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:326) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_281]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_281]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> 324202 INFO  (closeThreadPool-2513-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72986521681920008-127.0.0.1:44629_solr-n_0000000000) closing
   [junit4]   2> 324203 INFO  (OverseerStateUpdate-72986521681920008-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44629_solr
   [junit4]   2> 324210 INFO  (OverseerAutoScalingTriggerThread-72986521681920008-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 324210 WARN  (OverseerExitThread) [     ] o.a.s.c.Overseer Error communicating with ZooKeeper
   [junit4]   2>           => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2358) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:351) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:79) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:351) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:350) ~[java/:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> 324250 INFO  (TEST-OverseerTest.testShardAssignment-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testShardAssignment
   [junit4]   2> 324259 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testStateChange
   [junit4]   2> 324322 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 324326 INFO  (zkConnectionManagerCallback-2517-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 324326 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 324352 WARN  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6bcbb5c0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 324353 WARN  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6bcbb5c0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 324353 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 324365 WARN  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7c0e85ae[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 324365 WARN  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7c0e85ae[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 324376 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 324404 INFO  (zkConnectionManagerCallback-2526-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 324404 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 324406 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1879023067
   [junit4]   2> 324406 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1688044617
   [junit4]   2> 324410 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 324411 INFO  (zkConnectionManagerCallback-2531-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 324411 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 324413 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44629/solr ready
   [junit4]   2> 324415 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44629_solr
   [junit4]   2> 324416 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Overseer (id=72986521681920012-127.0.0.1:44629_solr-n_0000000000) starting
   [junit4]   2> 324427 INFO  (OverseerStateUpdate-72986521681920012-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44629_solr
   [junit4]   2> 324432 WARN  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
   [junit4]   2> 324433 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 324464 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 324471 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
   [junit4]   2> 324471 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 324554 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
   [junit4]   2> 324554 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 324657 WARN  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]-SendThread(127.0.0.1:44629)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1034cdad23e000c.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1034cdad23e000c, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1034cdad23e000c, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 324757 WARN  (OverseerStateUpdate-72986521681920012-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Solr cannot talk to ZK, exiting Overseer main queue loop
   [junit4]   2>           => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2746) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:327) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:79) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:327) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.ZkDistributedQueue.fetchZkChildren(ZkDistributedQueue.java:417) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.ZkDistributedQueue.firstChild(ZkDistributedQueue.java:394) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:448) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:239) [java/:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> 324758 INFO  (OverseerStateUpdate-72986521681920012-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44629_solr
   [junit4]   2> 324769 WARN  (OverseerExitThread) [     ] o.a.s.c.Overseer Error communicating with ZooKeeper
   [junit4]   2>           => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2358) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:351) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:79) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:351) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:350) ~[java/:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> 324769 WARN  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]-SendThread(127.0.0.1:44629)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1034cdad23e000e.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1034cdad23e000e, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1034cdad23e000e, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 324970 INFO  (closeThreadPool-2537-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72986521681920012-127.0.0.1:44629_solr-n_0000000000) closing
   [junit4]   2> 324971 INFO  (OverseerAutoScalingTriggerThread-72986521681920012-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 325006 INFO  (TEST-OverseerTest.testStateChange-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testStateChange
   [junit4]   2> 325013 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testShardLeaderChange
   [junit4]   2> 325094 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325099 WARN  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@42b81bd0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325099 WARN  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@42b81bd0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325100 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325101 INFO  (zkConnectionManagerCallback-2541-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325102 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325102 INFO  (zkConnectionManagerCallback-2546-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325102 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325104 WARN  (Thread-9154) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@62ddb161[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325104 WARN  (Thread-9154) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@62ddb161[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325104 INFO  (Thread-9154) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 325104 WARN  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@71dd151e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325104 WARN  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@71dd151e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325104 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 325104 WARN  (Thread-9154) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7d4b577a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325104 WARN  (Thread-9154) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7d4b577a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325108 WARN  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5d26ebdf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325108 WARN  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5d26ebdf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325109 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325109 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325110 INFO  (zkConnectionManagerCallback-2564-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325110 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325110 INFO  (zkConnectionManagerCallback-2562-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325112 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325114 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325117 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325117 INFO  (zkConnectionManagerCallback-2569-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325117 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325117 INFO  (zkConnectionManagerCallback-2574-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325117 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325119 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44629/solr ready
   [junit4]   2> 325119 INFO  (Thread-9154) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44629/solr ready
   [junit4]   2> 325121 INFO  (Thread-9154) [     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44629_solr
   [junit4]   2> 325122 INFO  (Thread-9154) [     ] o.a.s.c.Overseer Overseer (id=72986521681920015-127.0.0.1:44629_solr-n_0000000000) starting
   [junit4]   2> 325124 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325129 INFO  (zkConnectionManagerCallback-2576-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325129 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325138 INFO  (zkCallback-2434-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 325141 INFO  (zkCallback-2573-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 325142 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 325142 INFO  (zkCallback-2575-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 325145 INFO  (zkCallback-2568-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 325145 WARN  (Thread-9154) [     ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
   [junit4]   2> 325145 INFO  (Thread-9154) [     ] o.a.s.c.OverseerTest Killing overseer.
   [junit4]   2> 325146 INFO  (zkCallback-2545-thread-1) [     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44629_solr
   [junit4]   2> 325148 INFO  (zkCallback-2545-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72986521681920016-127.0.0.1:44629_solr-n_0000000001) starting
   [junit4]   2> 325158 WARN  (zkCallback-2545-thread-1) [     ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
   [junit4]   2> 325158 INFO  (OverseerStateUpdate-72986521681920016-127.0.0.1:44629_solr-n_0000000001) [     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44629_solr
   [junit4]   2> 325160 INFO  (OverseerStateUpdate-72986521681920016-127.0.0.1:44629_solr-n_0000000001) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 325246 INFO  (OverseerStateUpdate-72986521681920015-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer According to ZK I (id=72986521681920015-127.0.0.1:44629_solr-n_0000000000) am no longer a leader. propsId=null
   [junit4]   2> 325246 INFO  (OverseerStateUpdate-72986521681920015-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44629_solr
   [junit4]   2> 325246 INFO  (OverseerStateUpdate-72986521681920015-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer According to ZK I (id=72986521681920015-127.0.0.1:44629_solr-n_0000000000) am no longer a leader. propsId=null
   [junit4]   2> 325246 INFO  (OverseerStateUpdate-72986521681920015-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44629_solr
   [junit4]   2> 325247 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325248 WARN  (OverseerExitThread) [     ] o.a.s.c.Overseer Error communicating with ZooKeeper
   [junit4]   2>           => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2358) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:351) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:79) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:351) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:350) ~[java/:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> 325248 INFO  (zkConnectionManagerCallback-2587-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325248 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325248 INFO  (Thread-9154) [     ] o.a.s.c.Overseer Overseer (id=72986521681920016-127.0.0.1:44629_solr-n_0000000001) closing
   [junit4]   2> 325249 INFO  (OverseerStateUpdate-72986521681920016-127.0.0.1:44629_solr-n_0000000001) [     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44629_solr
   [junit4]   2> 325249 INFO  (OverseerAutoScalingTriggerThread-72986521681920016-127.0.0.1:44629_solr-n_0000000001) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 325353 WARN  (Thread-9154) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@35ea11dd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325353 WARN  (Thread-9154) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@35ea11dd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325354 INFO  (Thread-9154) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 325354 WARN  (Thread-9154) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@463b869c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325354 WARN  (Thread-9154) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@463b869c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 325355 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325356 INFO  (zkConnectionManagerCallback-2596-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325356 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325358 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325358 INFO  (zkConnectionManagerCallback-2601-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325358 INFO  (Thread-9154) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325359 INFO  (Thread-9154) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 325360 INFO  (Thread-9154) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44629/solr ready
   [junit4]   2> 325361 INFO  (Thread-9154) [     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44629_solr
   [junit4]   2> 325362 INFO  (Thread-9154) [     ] o.a.s.c.Overseer Overseer (id=72986521681920022-127.0.0.1:44629_solr-n_0000000002) starting
   [junit4]   2> 325365 WARN  (Thread-9154) [     ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
   [junit4]   2> 325365 INFO  (OverseerStateUpdate-72986521681920022-127.0.0.1:44629_solr-n_0000000002) [     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44629_solr
   [junit4]   2> 325367 INFO  (OverseerStateUpdate-72986521681920022-127.0.0.1:44629_solr-n_0000000002) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 325371 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
   [junit4]   2> 325373 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72986521681920021-node1:8983_core1-n_0000000000
   [junit4]   2> org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
   [junit4]   2> 	at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:129)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:857)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:845)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer.offerStateUpdate(Overseer.java:1018)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ShardLeaderElectionContextBase.java:187)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:138)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:251)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:927)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:2256)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$exists$3(SolrZkClient.java:315)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:79)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:315)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:120)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:105)
   [junit4]   2> 	at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:127)
   [junit4]   2> 	... 53 more
   [junit4]   2> 325375 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 325378 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
   [junit4]   2> 325379 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72986521681920021-node1:8983_core1-n_0000000001
   [junit4]   2> 325482 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 325486 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
   [junit4]   2> 325487 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72986521681920021-node1:8983_core1-n_0000000002
   [junit4]   2> 325488 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325489 INFO  (zkConnectionManagerCallback-2607-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325489 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325493 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
   [junit4]   2> 	at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:129)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:857)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:845)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:222)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:958)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:2256)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$exists$3(SolrZkClient.java:315)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:79)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:315)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:120)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:105)
   [junit4]   2> 	at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:127)
   [junit4]   2> 	... 47 more
   [junit4]   2> 325497 INFO  (zkCallback-2575-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 325497 INFO  (zkCallback-2573-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 325497 INFO  (zkCallback-2600-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 325497 INFO  (zkCallback-2586-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 325497 INFO  (zkCallback-2568-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 325497 INFO  (zkCallback-2434-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 325497 INFO  (zkCallback-2606-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 325498 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 325501 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
   [junit4]   2> 325502 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72986521681920021-node1:8983_core1-n_0000000003
   [junit4]   2> 325503 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 325506 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 325610 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
   [junit4]   2> 325611 INFO  (zkCallback-2606-thread-1) [     ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72986521681920025-node2:8984_core4-n_0000000004
   [junit4]   2> 325612 INFO  (zkCallback-2586-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 325613 INFO  (zkCallback-2573-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 325613 INFO  (zkCallback-2568-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 325613 INFO  (zkCallback-2600-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 325613 INFO  (zkCallback-2434-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 325613 INFO  (zkCallback-2575-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 325614 INFO  (zkCallback-2606-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 325614 WARN  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]-SendThread(127.0.0.1:44629)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1034cdad23e0015.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1034cdad23e0015, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1034cdad23e0015, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 325715 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325717 INFO  (zkConnectionManagerCallback-2611-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325717 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325720 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325721 INFO  (zkConnectionManagerCallback-2616-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325721 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325723 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 325724 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44629/solr ready
   [junit4]   2> 325726 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 325726 INFO  (zkConnectionManagerCallback-2618-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 325726 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 325729 INFO  (TEST-OverseerTest.testShardLeaderChange-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
   [junit4]   2> 	at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:129)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:857)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:845)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTest$MockZKController.createCollection(OverseerTest.java:193)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:917)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(Ab

[...truncated too long message...]

erseer Unable to check back-compat of .system collection - can't obtain ClusterState.
   [junit4]   2> 340658 INFO  (OverseerStateUpdate-72986521681920001-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44629_solr
   [junit4]   2> 340660 INFO  (TEST-OverseerTest.testOverseerStatsReset-seed#[9FE226E1AF235945]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 340769 INFO  (TEST-OverseerTest.testOverseerStatsReset-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
   [junit4]   2> 340771 INFO  (TEST-OverseerTest.testOverseerStatsReset-seed#[9FE226E1AF235945]) [     ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72986521681920116-127.0.0.1:8983_solrcore1-n_0000000000
   [junit4]   2> 340772 INFO  (TEST-OverseerTest.testOverseerStatsReset-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Overseer (id=72986521681920001-127.0.0.1:44629_solr-n_0000000000) closing
   [junit4]   2> 340772 INFO  (OverseerStateUpdate-72986521681920001-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44629_solr
   [junit4]   2> 340772 INFO  (OverseerAutoScalingTriggerThread-72986521681920001-127.0.0.1:44629_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 340774 WARN  (OverseerExitThread) [     ] o.a.s.c.Overseer I (id=72986521681920001-127.0.0.1:44629_solr-n_0000000000) am exiting, but I'm still the leader
   [junit4]   2> 340775 INFO  (TEST-OverseerTest.testOverseerStatsReset-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Overseer (id=72986521681920001-127.0.0.1:44629_solr-n_0000000000) closing
   [junit4]   2> 340776 INFO  (TEST-OverseerTest.testOverseerStatsReset-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Overseer (id=72986521681920001-127.0.0.1:44629_solr-n_0000000000) closing
   [junit4]   2> 340776 INFO  (TEST-OverseerTest.testOverseerStatsReset-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Overseer (id=72986521681920001-127.0.0.1:44629_solr-n_0000000000) closing
   [junit4]   2> 340776 INFO  (TEST-OverseerTest.testOverseerStatsReset-seed#[9FE226E1AF235945]) [     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44629_solr
   [junit4]   2> 340777 INFO  (TEST-OverseerTest.testOverseerStatsReset-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Overseer (id=72986521681920001-127.0.0.1:44629_solr-n_0000000001) starting
   [junit4]   2> 340780 WARN  (TEST-OverseerTest.testOverseerStatsReset-seed#[9FE226E1AF235945]) [     ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
   [junit4]   2> 340782 INFO  (OverseerStateUpdate-72986521681920001-127.0.0.1:44629_solr-n_0000000001) [     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44629_solr
   [junit4]   2> 340783 INFO  (zkCallback-3127-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 340783 INFO  (zkCallback-2434-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 340784 INFO  (zkCallback-3120-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 340987 INFO  (closeThreadPool-3143-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72986521681920001-127.0.0.1:44629_solr-n_0000000001) closing
   [junit4]   2> 340987 INFO  (OverseerAutoScalingTriggerThread-72986521681920001-127.0.0.1:44629_solr-n_0000000001) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 340988 INFO  (OverseerStateUpdate-72986521681920001-127.0.0.1:44629_solr-n_0000000001) [     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44629_solr
   [junit4]   2> 340990 WARN  (OverseerExitThread) [     ] o.a.s.c.Overseer I (id=72986521681920001-127.0.0.1:44629_solr-n_0000000001) am exiting, but I'm still the leader
   [junit4]   2> 341020 INFO  (TEST-OverseerTest.testOverseerStatsReset-seed#[9FE226E1AF235945]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testOverseerStatsReset
   [junit4]   1> / (0)
   [junit4]   1> 
   [junit4]   2> 341022 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 341224 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	95	/solr/aliases.json
   [junit4]   2> 	95	/solr/clusterprops.json
   [junit4]   2> 	88	/solr/collections/collection1/state.json
   [junit4]   2> 	13	/solr/collections/collection2/state.json
   [junit4]   2> 	5	/solr/collections/c1/state.json
   [junit4]   2> 	4	/solr/collections/collection3/state.json
   [junit4]   2> 	3	/solr/collections/collection0/state.json
   [junit4]   2> 	2	/solr/collections/collection4/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	692	/solr/clusterstate.json
   [junit4]   2> 	25	/solr/autoscaling.json
   [junit4]   2> 	3	/solr/collections/test/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	685	/solr/live_nodes
   [junit4]   2> 	204	/solr/overseer/queue
   [junit4]   2> 	154	/solr/collections
   [junit4]   2> 	26	/solr/overseer/queue-work
   [junit4]   2> 	25	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	25	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	24	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/collections/test/state.json
   [junit4]   2> 
   [junit4]   2> 341241 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1583365354
   [junit4]   2> 341241 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=632153697
   [junit4]   2> 341241 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=755205922
   [junit4]   2> 341242 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1170831984
   [junit4]   2> 341242 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=445749583
   [junit4]   2> 341242 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1346763410
   [junit4]   2> 341242 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1640910127
   [junit4]   2> 341242 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1876599196
   [junit4]   2> 341242 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=2039944905
   [junit4]   2> 341242 ERROR (Finalizer) [     ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=117039619
   [junit4]   2> 341248 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:44629
   [junit4]   2> 341248 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:44629
   [junit4]   2> 341248 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 44629
   [junit4]   2> 341248 INFO  (SUITE-OverseerTest-seed#[9FE226E1AF235945]-worker) [     ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Feb 12, 2021 11:11:21 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {}, docValues:{}, maxPointsInLeafNode=1563, maxMBSortInHeap=5.585782288622195, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=nl-BE, timezone=Antarctica/Macquarie
   [junit4]   2> NOTE: Linux 4.15.0-112-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=328238664,total=511705088
   [junit4]   2> NOTE: All tests run in this JVM: [TestCustomStream, TestSimClusterStateProvider, BasicAuthIntegrationTest, HdfsSyncSliceTest, TestSolrCachePerf, TestDocTermOrds, TestJsonFacetErrors, SliceStateTest, DistribCursorPagingTest, RecoveryZkTest, CustomCollectionTest, RandomizedTaggerTest, TestSimTriggerIntegration, TestCustomDocTransformer, SolrCoreTest, TestCloudManagedSchema, DirectUpdateHandlerTest, FacetPivotSmallTest, TestPartialUpdateDeduplication, DebugComponentTest, RequestHandlersTest, SplitShardTest, TestConfigSetsAPIShareSchema, TestStressRecovery, FieldMutatingUpdateProcessorTest, TestLRUCache, ZkStateReaderTest, AddBlockUpdateTest, BlockJoinFacetSimpleTest, SolrPluginUtilsTest, OverseerTest]
   [junit4] Completed [123/924 (1!)] on J0 in 20.26s, 14 tests, 1 error, 1 skipped <<< FAILURES!

[...truncated 53482 lines...]