You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/01/05 18:05:33 UTC
[JENKINS] Lucene-Solr-BadApples-Tests-master - Build # 582 - Still
Unstable
Build: https://builds.apache.org/job/Lucene-Solr-BadApples-Tests-master/582/
1 tests failed.
FAILED: org.apache.solr.cloud.OverseerTest.testShardLeaderChange
Error Message:
Captured an uncaught exception in thread: Thread[id=12314, name=OverseerCollectionConfigSetProcessor-73018739537739800-127.0.0.1:41653_solr-n_0000000000, state=RUNNABLE, group=Overseer collection creation process.]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=12314, name=OverseerCollectionConfigSetProcessor-73018739537739800-127.0.0.1:41653_solr-n_0000000000, state=RUNNABLE, group=Overseer collection creation process.]
at __randomizedtesting.SeedInfo.seed([DEEB100905D2259A:B897FE1F4AD06B]:0)
Caused by: org.apache.solr.common.AlreadyClosedException
at __randomizedtesting.SeedInfo.seed([DEEB100905D2259A]:0)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:69)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338)
at org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:424)
at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:155)
at java.base/java.lang.Thread.run(Thread.java:834)
Build Log:
[...truncated 13704 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> 790062 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.OverseerTest_DEEB100905D2259A-001/data-dir-82-001
[junit4] 2> 790062 WARN (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 790062 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 790063 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 790069 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 790070 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 790084 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 790084 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 790181 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:41653
[junit4] 2> 790181 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:41653
[junit4] 2> 790181 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:41653
[junit4] 2> 790181 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 41653
[junit4] 2> 790184 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 790185 INFO (zkConnectionManagerCallback-3967-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 790185 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 790196 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 790199 INFO (zkConnectionManagerCallback-3969-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 790199 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 790199 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 790199 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 790209 INFO (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testReplay
[junit4] 2> 790285 INFO (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 790286 INFO (zkConnectionManagerCallback-3973-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 790286 INFO (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 790296 WARN (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@512ea074[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 790296 WARN (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@512ea074[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 790389 INFO (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 790390 INFO (zkConnectionManagerCallback-3980-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 790390 INFO (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 790485 INFO (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 790486 INFO (zkConnectionManagerCallback-3985-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 790486 INFO (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 790488 INFO (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41653/solr ready
[junit4] 2> 790490 INFO (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41653_solr
[junit4] 2> 790491 INFO (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739778-127.0.0.1:41653_solr-n_0000000000) starting
[junit4] 2> 790495 INFO (OverseerStateUpdate-73018739537739778-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41653_solr
[junit4] 2> 790495 WARN (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 790911 INFO (closeThreadPool-3987-thread-1) [ ] o.a.s.c.Overseer Overseer (id=73018739537739778-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 790911 INFO (OverseerStateUpdate-73018739537739778-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41653_solr
[junit4] 2> 790911 INFO (OverseerAutoScalingTriggerThread-73018739537739778-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 790913 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 790934 INFO (TEST-OverseerTest.testReplay-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testReplay
[junit4] 2> 790939 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDoubleAssignment
[junit4] 2> 790997 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 790998 INFO (zkConnectionManagerCallback-3991-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 790998 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 791003 INFO (zkCallback-3968-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791003 INFO (zkCallback-3990-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791003 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 791009 INFO (zkConnectionManagerCallback-3995-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 791009 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 791014 WARN (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@191e3dfa[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 791014 WARN (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@191e3dfa[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 791016 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 791021 INFO (zkConnectionManagerCallback-4002-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 791021 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 791024 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 791028 INFO (zkConnectionManagerCallback-4007-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 791028 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 791029 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791030 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41653/solr ready
[junit4] 2> 791031 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41653_solr
[junit4] 2> 791032 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739782-127.0.0.1:41653_solr-n_0000000000) starting
[junit4] 2> 791038 INFO (OverseerStateUpdate-73018739537739782-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41653_solr
[junit4] 2> 791039 INFO (OverseerStateUpdate-73018739537739782-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791041 WARN (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 791058 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 791061 INFO (zkConnectionManagerCallback-4012-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 791061 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 791062 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791063 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41653/solr ready
[junit4] 2> 791170 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 791171 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/73018739537739781-node1_core1-n_0000000000
[junit4] 2> 791173 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 791175 INFO (zkCallback-3994-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 791175 INFO (zkCallback-3968-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 791175 INFO (zkCallback-4006-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 791175 INFO (zkCallback-3990-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 791175 INFO (zkCallback-4011-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 791276 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 791277 INFO (zkConnectionManagerCallback-4014-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 791277 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 791282 INFO (zkCallback-3994-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791282 INFO (zkCallback-4011-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791282 INFO (zkCallback-3968-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791282 INFO (zkCallback-4006-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791282 INFO (zkCallback-4013-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791284 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 791285 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/73018739537739786-node1_core1-n_0000000001
[junit4] 2> 791386 WARN (OverseerStateUpdate-73018739537739782-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Solr cannot talk to ZK, exiting Overseer main queue loop
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:2384) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:350) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:350) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:220) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:259) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 791386 INFO (OverseerStateUpdate-73018739537739782-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41653_solr
[junit4] 2> 791389 INFO (zkCallback-4006-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 791389 INFO (zkCallback-3968-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 791390 INFO (zkCallback-4011-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 791390 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 791390 INFO (zkCallback-4013-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 791697 INFO (closeThreadPool-4018-thread-1) [ ] o.a.s.c.Overseer Overseer (id=73018739537739782-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 791697 INFO (OverseerAutoScalingTriggerThread-73018739537739782-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 791724 INFO (TEST-OverseerTest.testDoubleAssignment-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDoubleAssignment
[junit4] 2> 791729 INFO (TEST-OverseerTest.testLatchWatcher-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testLatchWatcher
[junit4] 2> 791831 INFO (TEST-OverseerTest.testLatchWatcher-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testLatchWatcher
[junit4] 2> 791836 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOverseerFailure
[junit4] 2> 791889 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 791890 INFO (zkConnectionManagerCallback-4024-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 791890 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 791894 INFO (zkCallback-3968-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791894 INFO (zkCallback-4023-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791894 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 791895 INFO (zkConnectionManagerCallback-4028-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 791895 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 791901 WARN (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5d043fcd[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 791901 WARN (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5d043fcd[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 791901 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 791902 INFO (zkConnectionManagerCallback-4035-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 791902 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 791904 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 791905 INFO (zkConnectionManagerCallback-4040-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 791905 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 791906 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791906 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41653/solr ready
[junit4] 2> 791908 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41653_solr
[junit4] 2> 791909 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739788-127.0.0.1:41653_solr-n_0000000000) starting
[junit4] 2> 791913 WARN (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 791913 INFO (OverseerStateUpdate-73018739537739788-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41653_solr
[junit4] 2> 791917 INFO (OverseerStateUpdate-73018739537739788-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791921 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 791921 INFO (zkConnectionManagerCallback-4045-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 791922 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 791922 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 791923 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41653/solr ready
[junit4] 2> 792028 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 792030 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/73018739537739787-node1_core1-n_0000000000
[junit4] 2> 792031 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 792034 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 792035 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/73018739537739787-node1_core1-n_0000000001
[junit4] 2> 792036 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 792140 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 792142 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/73018739537739787-node1_core1-n_0000000002
[junit4] 2> 792243 WARN (OverseerStateUpdate-73018739537739788-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Solr cannot talk to ZK, exiting Overseer main queue loop
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:2384) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:350) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:350) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:220) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:259) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 792243 INFO (OverseerStateUpdate-73018739537739788-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41653_solr
[junit4] 2> 792246 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 792246 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 792247 INFO (zkConnectionManagerCallback-4047-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 792247 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 792247 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739788-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 792247 INFO (OverseerAutoScalingTriggerThread-73018739537739788-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 792251 WARN (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@715a9215[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 792251 WARN (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@715a9215[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 792251 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 792252 INFO (zkConnectionManagerCallback-4054-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 792252 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 792254 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 792255 INFO (zkConnectionManagerCallback-4059-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 792255 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 792256 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 792257 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41653/solr ready
[junit4] 2> 792258 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41653_solr
[junit4] 2> 792258 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739792-127.0.0.1:41653_solr-n_0000000001) starting
[junit4] 2> 792260 WARN (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 792261 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 792261 INFO (OverseerStateUpdate-73018739537739792-127.0.0.1:41653_solr-n_0000000001) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41653_solr
[junit4] 2> 792262 INFO (OverseerStateUpdate-73018739537739792-127.0.0.1:41653_solr-n_0000000001) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 792368 INFO (zkCallback-4044-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 792368 INFO (zkCallback-3968-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 792368 INFO (zkCallback-4023-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 792368 INFO (zkCallback-4039-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 792369 INFO (zkCallback-4058-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 792369 INFO (zkCallback-4046-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 792975 INFO (closeThreadPool-4061-thread-1) [ ] o.a.s.c.Overseer Overseer (id=73018739537739788-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 792975 INFO (closeThreadPool-4061-thread-2) [ ] o.a.s.c.Overseer Overseer (id=73018739537739792-127.0.0.1:41653_solr-n_0000000001) closing
[junit4] 2> 792975 INFO (OverseerAutoScalingTriggerThread-73018739537739792-127.0.0.1:41653_solr-n_0000000001) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 792976 INFO (OverseerStateUpdate-73018739537739792-127.0.0.1:41653_solr-n_0000000001) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41653_solr
[junit4] 2> 792978 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 793005 INFO (TEST-OverseerTest.testOverseerFailure-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testOverseerFailure
[junit4] 2> 793010 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOverseerStatsReset
[junit4] 2> 793071 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 793082 INFO (zkConnectionManagerCallback-4065-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 793082 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 793086 INFO (zkCallback-3968-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 793093 INFO (zkCallback-4064-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 793101 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 793109 INFO (zkConnectionManagerCallback-4072-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 793109 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 793110 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 793111 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41653/solr ready
[junit4] 2> 793120 WARN (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@61063293[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 793120 WARN (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@61063293[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 793122 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41653_solr
[junit4] 2> 793123 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739777-127.0.0.1:41653_solr-n_0000000000) starting
[junit4] 2> 793127 WARN (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 793130 INFO (OverseerStateUpdate-73018739537739777-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41653_solr
[junit4] 2> 793254 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 793255 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/73018739537739795-node1_core1-n_0000000000
[junit4] 2> 793256 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739777-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 793256 INFO (OverseerAutoScalingTriggerThread-73018739537739777-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 793257 INFO (OverseerStateUpdate-73018739537739777-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41653_solr
[junit4] 2> 793258 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739777-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 793258 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739777-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 793259 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739777-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 793259 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41653_solr
[junit4] 2> 793259 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer I (id=73018739537739777-127.0.0.1:41653_solr-n_0000000000) am exiting, but I'm still the leader
[junit4] 2> 793260 ERROR (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.LeaderElector node exists
[junit4] 2> => org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:126)
[junit4] 2> org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:126) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:1538) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$makePath$9(SolrZkClient.java:529) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:528) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:472) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:459) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:739) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.OverseerTest.testOverseerStatsReset(OverseerTest.java:757) ~[test/:?]
[junit4] 2> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
[junit4] 2> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
[junit4] 2> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 793260 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739777-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 793260 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739777-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 793260 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739777-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 793260 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739777-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 793261 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41653_solr
[junit4] 2> 793261 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739777-127.0.0.1:41653_solr-n_0000000002) starting
[junit4] 2> 793266 INFO (OverseerStateUpdate-73018739537739777-127.0.0.1:41653_solr-n_0000000002) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41653_solr
[junit4] 2> 793269 WARN (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 793270 INFO (zkCallback-4064-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 793270 INFO (zkCallback-4071-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 793271 INFO (zkCallback-3968-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 793474 INFO (closeThreadPool-4077-thread-1) [ ] o.a.s.c.Overseer Overseer (id=73018739537739777-127.0.0.1:41653_solr-n_0000000002) closing
[junit4] 2> 793474 INFO (OverseerAutoScalingTriggerThread-73018739537739777-127.0.0.1:41653_solr-n_0000000002) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 793474 INFO (OverseerStateUpdate-73018739537739777-127.0.0.1:41653_solr-n_0000000002) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41653_solr
[junit4] 2> 793477 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer I (id=73018739537739777-127.0.0.1:41653_solr-n_0000000002) am exiting, but I'm still the leader
[junit4] 2> 793497 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testOverseerStatsReset
[junit4] 2> 793502 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testRemovalOfLastReplica
[junit4] 2> 793549 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 793550 INFO (zkConnectionManagerCallback-4081-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 793550 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 793553 WARN (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@58050761[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 793553 WARN (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@58050761[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 793557 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 793558 INFO (zkConnectionManagerCallback-4088-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 793558 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 793561 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 793565 INFO (zkConnectionManagerCallback-4093-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 793565 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 793567 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41653/solr ready
[junit4] 2> 793568 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41653_solr
[junit4] 2> 793569 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Overseer (id=73018739537739797-127.0.0.1:41653_solr-n_0000000000) starting
[junit4] 2> 793573 WARN (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 793574 INFO (OverseerStateUpdate-73018739537739797-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41653_solr
[junit4] 2> 793582 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node13
[junit4] 2> 793701 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard2 coreNodeName=core_node14
[junit4] 2> 793702 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard3 coreNodeName=core_node15
[junit4] 2> 793703 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard4 coreNodeName=core_node16
[junit4] 2> 793703 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node9
[junit4] 2> 793704 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard2 coreNodeName=core_node10
[junit4] 2> 793704 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard3 coreNodeName=core_node11
[junit4] 2> 793705 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard4 coreNodeName=core_node12
[junit4] 2> 793705 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node5
[junit4] 2> 793705 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard2 coreNodeName=core_node6
[junit4] 2> 793706 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard3 coreNodeName=core_node7
[junit4] 2> 793706 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard4 coreNodeName=core_node8
[junit4] 2> 793707 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 793707 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard2 coreNodeName=core_node2
[junit4] 2> 793707 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard3 coreNodeName=core_node3
[junit4] 2> 793708 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard4 coreNodeName=core_node4
[junit4] 2> 793712 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node13
[junit4] 2> 793815 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard2 coreNodeName=core_node14
[junit4] 2> 793815 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard3 coreNodeName=core_node15
[junit4] 2> 793816 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard4 coreNodeName=core_node16
[junit4] 2> 793816 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node9
[junit4] 2> 793817 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard2 coreNodeName=core_node10
[junit4] 2> 793817 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard3 coreNodeName=core_node11
[junit4] 2> 793817 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard4 coreNodeName=core_node12
[junit4] 2> 793818 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node5
[junit4] 2> 793818 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard2 coreNodeName=core_node6
[junit4] 2> 793819 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard3 coreNodeName=core_node7
[junit4] 2> 793819 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard4 coreNodeName=core_node8
[junit4] 2> 793819 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 793820 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard2 coreNodeName=core_node2
[junit4] 2> 793820 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard3 coreNodeName=core_node3
[junit4] 2> 793821 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard4 coreNodeName=core_node4
[junit4] 2> 795669 INFO (OverseerCollectionConfigSetProcessor-73018739537739797-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskProcessor According to ZK I (id=73018739537739797-127.0.0.1:41653_solr-n_0000000000) am no longer a leader. propsId=null
[junit4] 2> 795770 INFO (closeThreadPool-4095-thread-1) [ ] o.a.s.c.Overseer Overseer (id=73018739537739797-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 795770 INFO (OverseerAutoScalingTriggerThread-73018739537739797-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 795771 INFO (OverseerStateUpdate-73018739537739797-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41653_solr
[junit4] 2> 795772 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 795795 INFO (TEST-OverseerTest.testRemovalOfLastReplica-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testRemovalOfLastReplica
[junit4] 2> 795799 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testShardLeaderChange
[junit4] 2> 795847 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 795847 INFO (zkConnectionManagerCallback-4099-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 795847 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 795850 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@43ddfb4d[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 795850 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@43ddfb4d[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 795851 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 795851 INFO (zkConnectionManagerCallback-4108-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 795852 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 795853 WARN (Thread-1923) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@34cb7883[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 795853 WARN (Thread-1923) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@34cb7883[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 795854 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5e46cefc[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 795854 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5e46cefc[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 795857 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 795858 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 795863 INFO (zkConnectionManagerCallback-4115-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 795863 INFO (zkConnectionManagerCallback-4118-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 795863 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 795863 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 795865 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 795866 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 795869 INFO (zkConnectionManagerCallback-4128-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 795869 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 795870 INFO (zkConnectionManagerCallback-4124-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 795870 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 795871 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41653/solr ready
[junit4] 2> 795871 INFO (Thread-1923) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41653/solr ready
[junit4] 2> 795873 INFO (Thread-1923) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41653_solr
[junit4] 2> 795873 INFO (Thread-1923) [ ] o.a.s.c.Overseer Overseer (id=73018739537739800-127.0.0.1:41653_solr-n_0000000000) starting
[junit4] 2> 795874 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 795878 INFO (zkConnectionManagerCallback-4130-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 795878 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 795882 INFO (OverseerStateUpdate-73018739537739800-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41653_solr
[junit4] 2> 795882 INFO (zkCallback-3968-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 795883 INFO (OverseerStateUpdate-73018739537739800-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 795888 WARN (Thread-1923) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 795888 INFO (Thread-1923) [ ] o.a.s.c.OverseerTest Killing overseer.
[junit4] 2> 795889 INFO (zkCallback-4127-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 795895 INFO (zkCallback-4129-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 795898 INFO (zkCallback-4123-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 795998 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 795998 INFO (zkCallback-4107-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41653_solr
[junit4] 2> 795999 INFO (zkConnectionManagerCallback-4134-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 795999 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 796000 INFO (zkCallback-4107-thread-1) [ ] o.a.s.c.Overseer Overseer (id=73018739537739801-127.0.0.1:41653_solr-n_0000000001) starting
[junit4] 2> 796003 WARN (zkCallback-4107-thread-1) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 796003 INFO (OverseerStateUpdate-73018739537739801-127.0.0.1:41653_solr-n_0000000001) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41653_solr
[junit4] 2> 796106 WARN (Thread-1923) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2cdc9936[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 796106 WARN (Thread-1923) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2cdc9936[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 796107 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 796108 INFO (zkConnectionManagerCallback-4141-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 796108 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 796111 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 796113 INFO (zkConnectionManagerCallback-4146-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 796113 INFO (Thread-1923) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 796114 INFO (Thread-1923) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 796115 INFO (Thread-1923) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41653/solr ready
[junit4] 2> 796115 INFO (Thread-1923) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41653_solr
[junit4] 2> 796116 INFO (Thread-1923) [ ] o.a.s.c.Overseer Overseer (id=73018739537739807-127.0.0.1:41653_solr-n_0000000002) starting
[junit4] 2> 796118 INFO (OverseerStateUpdate-73018739537739807-127.0.0.1:41653_solr-n_0000000002) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41653_solr
[junit4] 2> 796119 INFO (OverseerStateUpdate-73018739537739807-127.0.0.1:41653_solr-n_0000000002) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 796122 WARN (OverseerStateUpdate-73018739537739807-127.0.0.1:41653_solr-n_0000000002) [ ] o.a.s.c.o.ClusterStateMutator Collection collection1 already exists. exit
[junit4] 2> 796122 WARN (Thread-1923) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 796126 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 796130 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[DEEB100905D2259A]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/73018739537739806-node1_core1-n_0000000000
[junit4] 2> org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:129)
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:824)
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:812)
[junit4] 2> at org.apache.solr.cloud.Overseer.offerStateUpdate(Overseer.java:985)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:251)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218)
[junit4] 2> at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:250)
[junit4] 2> at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:925)
[junit4] 2> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:2021)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$exists$3(SolrZkClient.java:314)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:314)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:108)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:93)
[junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:127)
[junit4] 2> ... 49 more
[junit4] 2> org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:129)
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:824)
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:812)
[junit4] 2> at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:220)
[junit4] 2> at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:925)
[junit4] 2> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:2021)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$exists$3(SolrZkClient.java:314)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:314)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:108)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:93)
[junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:127)
[junit4] 2> ... 43 more
[junit4] 2> org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:129)
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:824)
[ju
[...truncated too long message...]
-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (c1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 815294 INFO (OverseerStateUpdate-73018739537739905-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"addreplica",
[junit4] 2> "collection":"test",
[junit4] 2> "shard":"x",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "state":"down"}
[junit4] 2> 815395 INFO (zkCallback-3968-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [0])
[junit4] 2> 815396 ERROR (OverseerStateUpdate-73018739537739905-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Exception in Overseer main queue loop
[junit4] 2> => org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /clusterstate.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:122)
[junit4] 2> org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /clusterstate.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:122) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:2384) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:350) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:350) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:220) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:259) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 815398 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (test) shard=x coreNodeName=core_node1
[junit4] 2> 815401 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[DEEB100905D2259A]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (c1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 815705 INFO (closeThreadPool-4588-thread-1) [ ] o.a.s.c.Overseer Overseer (id=73018739537739905-127.0.0.1:41653_solr-n_0000000000) closing
[junit4] 2> 815705 INFO (OverseerStateUpdate-73018739537739905-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41653_solr
[junit4] 2> 815705 INFO (OverseerAutoScalingTriggerThread-73018739537739905-127.0.0.1:41653_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 815707 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 815729 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[DEEB100905D2259A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testExternalClusterStateChangeBehavior
[junit4] 1> / (0)
[junit4] 1>
[junit4] 2> 815731 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 815933 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 143 /solr/collections/collection1/state.json
[junit4] 2> 105 /solr/aliases.json
[junit4] 2> 105 /solr/clusterprops.json
[junit4] 2> 13 /solr/collections/collection2/state.json
[junit4] 2> 5 /solr/collections/c1/state.json
[junit4] 2> 4 /solr/collections/collection3/state.json
[junit4] 2> 3 /solr/collections/collection0/state.json
[junit4] 2> 2 /solr/collections/collection4/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 969 /solr/clusterstate.json
[junit4] 2> 27 /solr/autoscaling.json
[junit4] 2> 3 /solr/collections/test/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 904 /solr/live_nodes
[junit4] 2> 250 /solr/overseer/queue
[junit4] 2> 164 /solr/collections
[junit4] 2> 29 /solr/overseer/queue-work
[junit4] 2> 27 /solr/autoscaling/events/.scheduled_maintenance
[junit4] 2> 27 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 25 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 815941 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:41653
[junit4] 2> 815941 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:41653
[junit4] 2> 815941 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 41653
[junit4] 2> 815941 INFO (SUITE-OverseerTest-seed#[DEEB100905D2259A]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Jan 05, 2020 5:12:29 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene84, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@251af1a7), locale=bs-Latn-BA, timezone=Australia/Broken_Hill
[junit4] 2> NOTE: Linux 4.15.0-54-generic amd64/Oracle Corporation 11.0.4 (64-bit)/cpus=4,threads=1,free=286523560,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestTolerantSearch, HttpPartitionTest, TestUniqueKeyFieldResource, RegexBytesRefFilterTest, TestSimScenario, DistribJoinFromCollectionTest, TestSort, PrimUtilsTest, TestCloudManagedSchema, DistributedIntervalFacetingTest, ConfigSetsAPITest, ConfigureRecoveryStrategyTest, DistributedFacetPivotSmallAdvancedTest, TestClusterProperties, TestMaxTokenLenTokenizer, LegacyCloudClusterPropTest, HighlighterTest, FileUtilsTest, TestPerFieldSimilarityWithDefaultOverride, CdcrUpdateLogTest, TestChildDocTransformerHierarchy, TestCloudConsistency, TestJoin, TestFieldCacheSortRandom, TestEmbeddedSolrServerConstructors, TestCoreContainer, ResponseBuilderTest, TestSchemalessBufferedUpdates, MetricTriggerIntegrationTest, DocumentBuilderTest, SolrShardReporterTest, TestGraphTermsQParserPlugin, LoggingHandlerTest, TestElisionMultitermQuery, MetricsHandlerTest, PreAnalyzedFieldManagedSchemaCloudTest, TestShardHandlerFactory, TestSolrCloudWithSecureImpersonation, ShardsWhitelistTest, TestNoOpRegenerator, TestSystemIdResolver, TestSimDistribStateManager, SynonymTokenizerTest, TestSnapshotCloudManager, TestCloudPhrasesIdentificationComponent, DocValuesNotIndexedTest, JSONWriterTest, TestInPlaceUpdatesRequiredField, DefaultValueUpdateProcessorTest, BJQParserTest, TestSegmentSorting, TestRangeQuery, TestPKIAuthenticationPlugin, LeaderFailureAfterFreshStartTest, TestGraphMLResponseWriter, TestCollapseQParserPlugin, TestHdfsUpdateLog, MultiThreadedOCPTest, TestRetrieveFieldsOptimizer, QueryEqualityTest, ExitableDirectoryReaderTest, MoveReplicaHDFSTest, HdfsSyncSliceTest, TestWaitForStateWithJettyShutdowns, SearchRateTriggerTest, TestSolrCloudSnapshots, HdfsRecoverLeaseTest, TestQueryingOnDownCollection, LeaderElectionIntegrationTest, SchemaVersionSpecificBehaviorTest, TermVectorComponentTest, XCJFQueryTest, TestNestedUpdateProcessor, SystemInfoHandlerTest, TestReplicationHandlerBackup, DeleteNodeTest, ScheduledTriggerIntegrationTest, RemoteQueryErrorTest, TestManagedSynonymGraphFilterFactory, NumericFieldsTest, SpatialFilterTest, TestFilteredDocIdSet, TestFieldCache, HLLSerializationTest, AutoAddReplicasPlanActionTest, TestLegacyBM25SimilarityFactory, OverseerTest]
[junit4] Completed [261/897 (1!)] on J2 in 26.62s, 14 tests, 1 error, 1 skipped <<< FAILURES!
[...truncated 55102 lines...]