You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/08/07 05:44:59 UTC

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.4) - Build # 22616 - Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/22616/
Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  org.apache.solr.client.solrj.io.stream.MathExpressionTest.testMultiVariateNormalDistribution

Error Message:
[-3.2124788454459896, 40.43704103619221]

Stack Trace:
java.lang.AssertionError: [-3.2124788454459896, 40.43704103619221]
	at __randomizedtesting.SeedInfo.seed([F87D0365A7F86D44:62868A1290D12F4F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.client.solrj.io.stream.MathExpressionTest.testMultiVariateNormalDistribution(MathExpressionTest.java:3010)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica

Error Message:
Expected 1x2 collections null Live Nodes: [127.0.0.1:33249_solr, 127.0.0.1:35135_solr, 127.0.0.1:35621_solr, 127.0.0.1:41227_solr] Last available state: null

Stack Trace:
java.lang.AssertionError: Expected 1x2 collections
null
Live Nodes: [127.0.0.1:33249_solr, 127.0.0.1:35135_solr, 127.0.0.1:35621_solr, 127.0.0.1:41227_solr]
Last available state: null
	at __randomizedtesting.SeedInfo.seed([640A9F6EA21DF59:6C56C82682D39593]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:278)
	at org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:237)
	at org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:228)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 13166 lines...]
   [junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/init-core-data-001
   [junit4]   2> 395160 WARN  (SUITE-DeleteReplicaTest-seed#[640A9F6EA21DF59]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 395160 INFO  (SUITE-DeleteReplicaTest-seed#[640A9F6EA21DF59]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 395160 INFO  (SUITE-DeleteReplicaTest-seed#[640A9F6EA21DF59]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 395161 INFO  (SUITE-DeleteReplicaTest-seed#[640A9F6EA21DF59]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 395161 INFO  (SUITE-DeleteReplicaTest-seed#[640A9F6EA21DF59]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001
   [junit4]   2> 395161 INFO  (SUITE-DeleteReplicaTest-seed#[640A9F6EA21DF59]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 395161 INFO  (Thread-958) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 395161 INFO  (Thread-958) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 395163 ERROR (Thread-958) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 395261 INFO  (SUITE-DeleteReplicaTest-seed#[640A9F6EA21DF59]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:39719
   [junit4]   2> 395263 INFO  (zkConnectionManagerCallback-1489-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395284 INFO  (jetty-launcher-1486-thread-3) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9.0.4+11
   [junit4]   2> 395284 INFO  (jetty-launcher-1486-thread-4) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9.0.4+11
   [junit4]   2> 395285 INFO  (jetty-launcher-1486-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9.0.4+11
   [junit4]   2> 395284 INFO  (jetty-launcher-1486-thread-2) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9.0.4+11
   [junit4]   2> 395292 INFO  (jetty-launcher-1486-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 395292 INFO  (jetty-launcher-1486-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 395293 INFO  (jetty-launcher-1486-thread-2) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 395293 INFO  (jetty-launcher-1486-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6e0d9673{/solr,null,AVAILABLE}
   [junit4]   2> 395294 INFO  (jetty-launcher-1486-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 395294 INFO  (jetty-launcher-1486-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 395294 INFO  (jetty-launcher-1486-thread-3) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@440460dc{SSL,[ssl, http/1.1]}{127.0.0.1:41227}
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-2) [    ] o.e.j.s.Server Started @395337ms
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2e1fcdc6{/solr,null,AVAILABLE}
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41227}
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-4) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 395298 ERROR (jetty-launcher-1486-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@25f99c5a{/solr,null,AVAILABLE}
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-08-07T05:00:57.468734Z
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@69767d5a{SSL,[ssl, http/1.1]}{127.0.0.1:35135}
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-3) [    ] o.e.j.s.Server Started @395337ms
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 395298 INFO  (jetty-launcher-1486-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35135}
   [junit4]   2> 395298 ERROR (jetty-launcher-1486-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 395299 INFO  (jetty-launcher-1486-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 395299 INFO  (jetty-launcher-1486-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 395299 INFO  (jetty-launcher-1486-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 395299 INFO  (jetty-launcher-1486-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 395299 INFO  (jetty-launcher-1486-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-08-07T05:00:57.469162Z
   [junit4]   2> 395299 INFO  (jetty-launcher-1486-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@48ee143c{/solr,null,AVAILABLE}
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1f1cdbb3{SSL,[ssl, http/1.1]}{127.0.0.1:33249}
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-4) [    ] o.e.j.s.Server Started @395338ms
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33249}
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@22ff136e{SSL,[ssl, http/1.1]}{127.0.0.1:35621}
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-1) [    ] o.e.j.s.Server Started @395339ms
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35621}
   [junit4]   2> 395300 ERROR (jetty-launcher-1486-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 395300 ERROR (jetty-launcher-1486-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-08-07T05:00:57.470470Z
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 395300 INFO  (jetty-launcher-1486-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-08-07T05:00:57.470578Z
   [junit4]   2> 395301 INFO  (zkConnectionManagerCallback-1491-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395301 INFO  (zkConnectionManagerCallback-1493-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395301 INFO  (jetty-launcher-1486-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 395301 INFO  (jetty-launcher-1486-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 395301 INFO  (zkConnectionManagerCallback-1495-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395301 INFO  (jetty-launcher-1486-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 395301 INFO  (zkConnectionManagerCallback-1497-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395302 INFO  (jetty-launcher-1486-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 395363 INFO  (jetty-launcher-1486-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39719/solr
   [junit4]   2> 395363 INFO  (zkConnectionManagerCallback-1501-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395365 INFO  (zkConnectionManagerCallback-1503-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395393 INFO  (jetty-launcher-1486-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39719/solr
   [junit4]   2> 395394 INFO  (zkConnectionManagerCallback-1509-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395398 INFO  (zkConnectionManagerCallback-1511-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395400 INFO  (jetty-launcher-1486-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39719/solr
   [junit4]   2> 395401 INFO  (zkConnectionManagerCallback-1515-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395402 INFO  (zkConnectionManagerCallback-1519-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395403 INFO  (jetty-launcher-1486-thread-4) [n:127.0.0.1:33249_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33249_solr
   [junit4]   2> 395404 INFO  (jetty-launcher-1486-thread-4) [n:127.0.0.1:33249_solr    ] o.a.s.c.Overseer Overseer (id=72117909584347142-127.0.0.1:33249_solr-n_0000000000) starting
   [junit4]   2> 395404 INFO  (jetty-launcher-1486-thread-2) [n:127.0.0.1:41227_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41227_solr
   [junit4]   2> 395405 INFO  (jetty-launcher-1486-thread-3) [n:127.0.0.1:35135_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 395407 INFO  (jetty-launcher-1486-thread-3) [n:127.0.0.1:35135_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 395407 INFO  (jetty-launcher-1486-thread-3) [n:127.0.0.1:35135_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35135_solr
   [junit4]   2> 395419 INFO  (zkCallback-1510-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 395419 INFO  (zkCallback-1502-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 395423 INFO  (zkCallback-1510-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 395426 INFO  (zkCallback-1518-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 395431 INFO  (zkConnectionManagerCallback-1526-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395431 INFO  (zkConnectionManagerCallback-1532-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395431 INFO  (zkConnectionManagerCallback-1536-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395431 INFO  (jetty-launcher-1486-thread-4) [n:127.0.0.1:33249_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 395431 INFO  (jetty-launcher-1486-thread-2) [n:127.0.0.1:41227_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 395431 INFO  (jetty-launcher-1486-thread-3) [n:127.0.0.1:35135_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 395432 INFO  (jetty-launcher-1486-thread-4) [n:127.0.0.1:33249_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39719/solr ready
   [junit4]   2> 395432 INFO  (jetty-launcher-1486-thread-2) [n:127.0.0.1:41227_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39719/solr ready
   [junit4]   2> 395432 INFO  (jetty-launcher-1486-thread-3) [n:127.0.0.1:35135_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39719/solr ready
   [junit4]   2> 395432 INFO  (OverseerStateUpdate-72117909584347142-127.0.0.1:33249_solr-n_0000000000) [    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:33249_solr
   [junit4]   2> 395432 INFO  (jetty-launcher-1486-thread-2) [n:127.0.0.1:41227_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 395432 INFO  (jetty-launcher-1486-thread-3) [n:127.0.0.1:35135_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 395434 INFO  (jetty-launcher-1486-thread-4) [n:127.0.0.1:33249_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 395434 INFO  (jetty-launcher-1486-thread-4) [n:127.0.0.1:33249_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33249_solr
   [junit4]   2> 395434 INFO  (zkCallback-1502-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 395439 INFO  (zkCallback-1535-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 395440 INFO  (zkCallback-1510-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 395440 INFO  (zkCallback-1525-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 395440 INFO  (zkCallback-1531-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 395440 INFO  (zkCallback-1518-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 395441 INFO  (jetty-launcher-1486-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39719/solr
   [junit4]   2> 395441 INFO  (zkConnectionManagerCallback-1542-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395443 INFO  (zkConnectionManagerCallback-1544-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395446 INFO  (jetty-launcher-1486-thread-4) [n:127.0.0.1:33249_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 395447 INFO  (jetty-launcher-1486-thread-1) [n:127.0.0.1:35621_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 395448 INFO  (jetty-launcher-1486-thread-1) [n:127.0.0.1:35621_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 395448 INFO  (jetty-launcher-1486-thread-1) [n:127.0.0.1:35621_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35621_solr
   [junit4]   2> 395449 INFO  (zkCallback-1535-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 395449 INFO  (zkCallback-1502-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 395449 INFO  (zkCallback-1510-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 395449 INFO  (zkCallback-1518-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 395449 INFO  (zkCallback-1525-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 395450 INFO  (zkCallback-1543-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 395450 INFO  (zkCallback-1531-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 395450 INFO  (jetty-launcher-1486-thread-3) [n:127.0.0.1:35135_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35135.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395451 INFO  (jetty-launcher-1486-thread-2) [n:127.0.0.1:41227_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41227.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395456 INFO  (jetty-launcher-1486-thread-3) [n:127.0.0.1:35135_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35135.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395456 INFO  (jetty-launcher-1486-thread-3) [n:127.0.0.1:35135_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35135.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395456 INFO  (jetty-launcher-1486-thread-3) [n:127.0.0.1:35135_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node3/.
   [junit4]   2> 395458 INFO  (jetty-launcher-1486-thread-2) [n:127.0.0.1:41227_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41227.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395458 INFO  (jetty-launcher-1486-thread-4) [n:127.0.0.1:33249_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33249.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395459 INFO  (jetty-launcher-1486-thread-2) [n:127.0.0.1:41227_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41227.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395459 INFO  (jetty-launcher-1486-thread-2) [n:127.0.0.1:41227_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node2/.
   [junit4]   2> 395463 INFO  (zkConnectionManagerCallback-1552-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395463 INFO  (jetty-launcher-1486-thread-1) [n:127.0.0.1:35621_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 395463 INFO  (jetty-launcher-1486-thread-4) [n:127.0.0.1:33249_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33249.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395464 INFO  (jetty-launcher-1486-thread-4) [n:127.0.0.1:33249_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33249.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395464 INFO  (jetty-launcher-1486-thread-1) [n:127.0.0.1:35621_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39719/solr ready
   [junit4]   2> 395464 INFO  (jetty-launcher-1486-thread-1) [n:127.0.0.1:35621_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 395464 INFO  (jetty-launcher-1486-thread-4) [n:127.0.0.1:33249_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node4/.
   [junit4]   2> 395479 INFO  (jetty-launcher-1486-thread-1) [n:127.0.0.1:35621_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35621.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395485 INFO  (jetty-launcher-1486-thread-1) [n:127.0.0.1:35621_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35621.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395485 INFO  (jetty-launcher-1486-thread-1) [n:127.0.0.1:35621_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35621.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 395486 INFO  (jetty-launcher-1486-thread-1) [n:127.0.0.1:35621_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node1/.
   [junit4]   2> 395545 INFO  (zkConnectionManagerCallback-1555-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395547 INFO  (zkConnectionManagerCallback-1560-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395548 INFO  (SUITE-DeleteReplicaTest-seed#[640A9F6EA21DF59]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 395548 INFO  (SUITE-DeleteReplicaTest-seed#[640A9F6EA21DF59]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39719/solr ready
   [junit4]   2> 395565 INFO  (TEST-DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup-seed#[640A9F6EA21DF59]) [    ] o.a.s.SolrTestCaseJ4 ###Starting deleteReplicaAndVerifyDirectoryCleanup
   [junit4]   2> 395575 INFO  (qtp556448094-5618) [n:127.0.0.1:33249_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&name=deletereplica_test&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 395576 INFO  (OverseerThreadFactory-2298-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection deletereplica_test
   [junit4]   2> 395680 INFO  (OverseerStateUpdate-72117909584347142-127.0.0.1:33249_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deletereplica_test",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deletereplica_test_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:35135/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 395681 INFO  (OverseerStateUpdate-72117909584347142-127.0.0.1:33249_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deletereplica_test",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deletereplica_test_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33249/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 395886 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr    x:deletereplica_test_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=deletereplica_test_shard1_replica_n2&action=CREATE&numShards=1&collection=deletereplica_test&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 395894 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr    x:deletereplica_test_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=deletereplica_test_shard1_replica_n1&action=CREATE&numShards=1&collection=deletereplica_test&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 396893 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 396897 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.s.IndexSchema [deletereplica_test_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 396898 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 396899 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'deletereplica_test_shard1_replica_n2' using configuration from collection deletereplica_test, trusted=true
   [junit4]   2> 396899 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33249.solr.core.deletereplica_test.shard1.replica_n2' (registry 'solr.core.deletereplica_test.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 396899 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 396899 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.SolrCore [[deletereplica_test_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node4/deletereplica_test_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node4/./deletereplica_test_shard1_replica_n2/data/]
   [junit4]   2> 396901 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 396910 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.s.IndexSchema [deletereplica_test_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 396912 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 396912 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'deletereplica_test_shard1_replica_n1' using configuration from collection deletereplica_test, trusted=true
   [junit4]   2> 396912 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35135.solr.core.deletereplica_test.shard1.replica_n1' (registry 'solr.core.deletereplica_test.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 396913 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 396913 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.SolrCore [[deletereplica_test_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node3/deletereplica_test_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node3/./deletereplica_test_shard1_replica_n1/data/]
   [junit4]   2> 396940 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 396940 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 396941 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 396941 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 396941 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@6f933bda[deletereplica_test_shard1_replica_n2] main]
   [junit4]   2> 396942 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 396942 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 396943 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 396943 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1608115089952473088
   [junit4]   2> 396943 INFO  (searcherExecutor-2312-thread-1-processing-n:127.0.0.1:33249_solr x:deletereplica_test_shard1_replica_n2 c:deletereplica_test s:shard1 r:core_node4) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.SolrCore [deletereplica_test_shard1_replica_n2] Registered new searcher Searcher@6f933bda[deletereplica_test_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 396946 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deletereplica_test/terms/shard1 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 396947 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 396962 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 396962 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 396963 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 396963 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 396965 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@51f8340e[deletereplica_test_shard1_replica_n1] main]
   [junit4]   2> 396966 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 396966 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 396967 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 396967 INFO  (searcherExecutor-2313-thread-1-processing-n:127.0.0.1:35135_solr x:deletereplica_test_shard1_replica_n1 c:deletereplica_test s:shard1 r:core_node3) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.SolrCore [deletereplica_test_shard1_replica_n1] Registered new searcher Searcher@51f8340e[deletereplica_test_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 396967 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1608115089977638912
   [junit4]   2> 396971 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deletereplica_test/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 397448 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 397448 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 397448 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:33249/solr/deletereplica_test_shard1_replica_n2/
   [junit4]   2> 397449 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=deletereplica_test_shard1_replica_n2 url=https://127.0.0.1:33249/solr START replicas=[https://127.0.0.1:35135/solr/deletereplica_test_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 397449 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=deletereplica_test_shard1_replica_n2 url=https://127.0.0.1:33249/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 397452 INFO  (qtp503423942-5615) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.S.Request [deletereplica_test_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 397453 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 397453 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 397453 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 397455 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:33249/solr/deletereplica_test_shard1_replica_n2/ shard1
   [junit4]   2> 397556 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 397557 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deletereplica_test s:shard1 r:core_node4 x:deletereplica_test_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=deletereplica_test_shard1_replica_n2&action=CREATE&numShards=1&collection=deletereplica_test&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1671
   [junit4]   2> 397657 INFO  (zkCallback-1502-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletereplica_test/state.json] for collection [deletereplica_test] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 397974 INFO  (qtp503423942-5612) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=deletereplica_test_shard1_replica_n1&action=CREATE&numShards=1&collection=deletereplica_test&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2080
   [junit4]   2> 397976 INFO  (qtp556448094-5618) [n:127.0.0.1:33249_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 398074 INFO  (zkCallback-1518-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletereplica_test/state.json] for collection [deletereplica_test] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 398074 INFO  (zkCallback-1502-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletereplica_test/state.json] for collection [deletereplica_test] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 398976 INFO  (qtp556448094-5618) [n:127.0.0.1:33249_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&name=deletereplica_test&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3401
   [junit4]   2> 398978 INFO  (qtp556448094-5621) [n:127.0.0.1:33249_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=true&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 398979 INFO  (qtp556448094-5618) [n:127.0.0.1:33249_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletereplica with params replica=core_node4&action=DELETEREPLICA&collection=deletereplica_test&shard=shard1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 398986 INFO  (OverseerCollectionConfigSetProcessor-72117909584347142-127.0.0.1:33249_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 398988 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deletereplica_test_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.deletereplica_test.shard1.replica_n2, tag=null
   [junit4]   2> 398988 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deletereplica_test_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@d01cd9a: rootName = solr_33249, domain = solr.core.deletereplica_test.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.deletereplica_test.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@6688172e
   [junit4]   2> 399001 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deletereplica_test_shard1_replica_n2] o.a.s.c.SolrCore [deletereplica_test_shard1_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@6d5db5d8
   [junit4]   2> 399001 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deletereplica_test_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.deletereplica_test.shard1.replica_n2, tag=6d5db5d8
   [junit4]   2> 399001 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deletereplica_test_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.deletereplica_test.shard1.leader, tag=6d5db5d8
   [junit4]   2> 399004 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deletereplica_test_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deletereplica_test/terms/shard1 to Terms{values={core_node3=0}, version=2}
   [junit4]   2> 399005 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deletereplica_test_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=deletereplica_test_shard1_replica_n2&deleteMetricsHistory=true&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2&deleteIndex=true} status=0 QTime=17
   [junit4]   2> 399005 INFO  (zkCallback-1518-thread-2) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 399106 INFO  (zkCallback-1502-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletereplica_test/state.json] for collection [deletereplica_test] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 399106 INFO  (zkCallback-1518-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletereplica_test/state.json] for collection [deletereplica_test] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 399207 INFO  (qtp556448094-5618) [n:127.0.0.1:33249_solr c:deletereplica_test   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replica=core_node4&action=DELETEREPLICA&collection=deletereplica_test&shard=shard1&wt=javabin&version=2} status=0 QTime=227
   [junit4]   2> 400987 INFO  (OverseerCollectionConfigSetProcessor-72117909584347142-127.0.0.1:33249_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 401506 INFO  (zkCallback-1518-thread-2) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:35135/solr/deletereplica_test_shard1_replica_n1/
   [junit4]   2> 401506 INFO  (zkCallback-1518-thread-2) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 401506 INFO  (zkCallback-1518-thread-2) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:35135/solr/deletereplica_test_shard1_replica_n1/ has no replicas
   [junit4]   2> 401508 INFO  (zkCallback-1518-thread-2) [n:127.0.0.1:35135_solr c:deletereplica_test s:shard1 r:core_node3 x:deletereplica_test_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:35135/solr/deletereplica_test_shard1_replica_n1/ shard1
   [junit4]   2> 401508 INFO  (zkCallback-1518-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletereplica_test/state.json] for collection [deletereplica_test] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 401526 INFO  (TEST-DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup-seed#[640A9F6EA21DF59]) [    ] o.a.s.SolrTestCaseJ4 ###Ending deleteReplicaAndVerifyDirectoryCleanup
   [junit4]   2> 401545 INFO  (TEST-DeleteReplicaTest.deleteReplicaByCount-seed#[640A9F6EA21DF59]) [    ] o.a.s.SolrTestCaseJ4 ###Starting deleteReplicaByCount
   [junit4]   2> 401546 INFO  (qtp556448094-5621) [n:127.0.0.1:33249_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=2&collection.configName=conf&name=deleteByCount&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 401547 INFO  (OverseerThreadFactory-2298-thread-3) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection deleteByCount
   [junit4]   2> 401754 INFO  (OverseerStateUpdate-72117909584347142-127.0.0.1:33249_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteByCount",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deleteByCount_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:35135/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 401755 INFO  (OverseerStateUpdate-72117909584347142-127.0.0.1:33249_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteByCount",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deleteByCount_shard1_replica_p2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:35621/solr",
   [junit4]   2>   "type":"PULL",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 401756 INFO  (OverseerStateUpdate-72117909584347142-127.0.0.1:33249_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteByCount",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deleteByCount_shard1_replica_p4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33249/solr",
   [junit4]   2>   "type":"PULL",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 401957 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr    x:deleteByCount_shard1_replica_p4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_p4&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=PULL
   [junit4]   2> 401959 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr    x:deleteByCount_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_n1&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 401968 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr    x:deleteByCount_shard1_replica_p2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_p2&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=PULL
   [junit4]   2> 402968 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 402985 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 402986 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.s.IndexSchema [deleteByCount_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 402989 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 402989 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'deleteByCount_shard1_replica_n1' using configuration from collection deleteByCount, trusted=true
   [junit4]   2> 402989 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35135.solr.core.deleteByCount.shard1.replica_n1' (registry 'solr.core.deleteByCount.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 402989 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 402990 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SolrCore [[deleteByCount_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node3/deleteByCount_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node3/./deleteByCount_shard1_replica_n1/data/]
   [junit4]   2> 402990 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.s.IndexSchema [deleteByCount_shard1_replica_p4] Schema name=minimal
   [junit4]   2> 402992 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 402992 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.CoreContainer Creating SolrCore 'deleteByCount_shard1_replica_p4' using configuration from collection deleteByCount, trusted=true
   [junit4]   2> 402993 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33249.solr.core.deleteByCount.shard1.replica_p4' (registry 'solr.core.deleteByCount.shard1.replica_p4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 402993 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 402993 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.SolrCore [[deleteByCount_shard1_replica_p4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node4/deleteByCount_shard1_replica_p4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node4/./deleteByCount_shard1_replica_p4/data/]
   [junit4]   2> 403013 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 403043 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.s.IndexSchema [deleteByCount_shard1_replica_p2] Schema name=minimal
   [junit4]   2> 403044 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 403044 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.CoreContainer Creating SolrCore 'deleteByCount_shard1_replica_p2' using configuration from collection deleteByCount, trusted=true
   [junit4]   2> 403045 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35621.solr.core.deleteByCount.shard1.replica_p2' (registry 'solr.core.deleteByCount.shard1.replica_p2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b63ef2b
   [junit4]   2> 403045 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 403045 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.SolrCore [[deleteByCount_shard1_replica_p2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node1/deleteByCount_shard1_replica_p2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001/tempDir-001/node1/./deleteByCount_shard1_replica_p2/data/]
   [junit4]   2> 403102 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 403103 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 403104 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 403104 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 403106 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@c192e9d[deleteByCount_shard1_replica_n1] main]
   [junit4]   2> 403107 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 403107 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 403108 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 403123 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 403123 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 403124 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1608115096433721344
   [junit4]   2> 403126 INFO  (searcherExecutor-2322-thread-1-processing-n:127.0.0.1:35135_solr x:deleteByCount_shard1_replica_n1 c:deleteByCount s:shard1 r:core_node3) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SolrCore [deleteByCount_shard1_replica_n1] Registered new searcher Searcher@c192e9d[deleteByCount_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 403127 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.s.SolrIndexSearcher Opening [Searcher@6fdc4f19[deleteByCount_shard1_replica_p4] main]
   [junit4]   2> 403128 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 403128 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 403129 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 403130 INFO  (searcherExecutor-2323-thread-1-processing-n:127.0.0.1:33249_solr x:deleteByCount_shard1_replica_p4 c:deleteByCount s:shard1 r:core_node6) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p4] Registered new searcher Searcher@6fdc4f19[deleteByCount_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 403130 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteByCount/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 403132 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.ZkController deleteByCount_shard1_replica_p4 starting background replication from leader
   [junit4]   2> 403132 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 403133 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 403133 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 403133 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:35135/solr/deleteByCount_shard1_replica_n1/
   [junit4]   2> 403133 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 403133 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:35135/solr/deleteByCount_shard1_replica_n1/ has no replicas
   [junit4]   2> 403133 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 403135 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:35135/solr/deleteByCount_shard1_replica_n1/ shard1
   [junit4]   2> 403138 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 403138 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 403150 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 403150 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 403151 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.s.SolrIndexSearcher Opening [Searcher@613f414[deleteByCount_shard1_replica_p2] main]
   [junit4]   2> 403152 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 403152 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 403152 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 403156 INFO  (searcherExecutor-2324-thread-1-processing-n:127.0.0.1:35621_solr x:deleteByCount_shard1_replica_p2 c:deleteByCount s:shard1 r:core_node5) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p2] Registered new searcher Searcher@613f414[deleteByCount_shard1_replica_p2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 403158 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.ZkController deleteByCount_shard1_replica_p2 starting background replication from leader
   [junit4]   2> 403158 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 403162 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 403162 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 403237 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 403281 INFO  (qtp1045458938-5622) [n:127.0.0.1:35621_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_p2&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=1313
   [junit4]   2> 403281 INFO  (qtp556448094-5623) [n:127.0.0.1:33249_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_p4&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=1323
   [junit4]   2> 403284 INFO  (qtp503423942-5610) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_n1&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1325
   [junit4]   2> 403286 INFO  (qtp556448094-5621) [n:127.0.0.1:33249_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 403366 INFO  (zkCallback-1502-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 403366 INFO  (zkCallback-1543-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 403373 INFO  (zkCallback-1518-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 403548 INFO  (OverseerCollectionConfigSetProcessor-72117909584347142-127.0.0.1:33249_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 403804 INFO  (indexFetcher-2334-thread-1) [    ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:35135/solr/deleteByCount_shard1_replica_n1/
   [junit4]   2> 403807 INFO  (qtp503423942-5744) [n:127.0.0.1:35135_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.S.Request [deleteByCount_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 403807 INFO  (indexFetcher-2334-thread-1) [    ] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 403807 INFO  (indexFetcher-2334-thread-1) [    ] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 403807 INFO  (indexFetcher-2334-thread-1) [    ] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 403807 INFO  (indexFetcher-2334-thread-1) [    ] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 403807 INFO  (indexFetcher-2334-thread-1) [    ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 403807 INFO  (indexFetcher-2334-thread-1) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 403808 INFO  (indexFetcher-2334-thread-1) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@410460e2 commitCommandVersion:0
   [junit4]   2> 403809 INFO  (indexFetcher-2334-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@efe8c89[deleteByCount_shard1_replica_p4] main]
   [junit4]   2> 403809 INFO  (indexFetcher-2334-thread-1) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 403810 INFO  (searcherExecutor-2323-thread-1) [    ] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p4] Registered new searcher Searcher@efe8c89[deleteByCount_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 404286 INFO  (qtp556448094-5621) [n:127.0.0.1:33249_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=2&collection.configName=conf&name=deleteByCount&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=2740
   [junit4]   2> 404288 INFO  (qtp556448094-5618) [n:127.0.0.1:33249_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletereplica with params count=2&action=DELETEREPLICA&collection=deleteByCount&shard=shard1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 404292 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deleteByCount_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.deleteByCount.shard1.replica_p4, tag=null
   [junit4]   2> 404292 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deleteByCount_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4c0a7aa6: rootName = solr_33249, domain = solr.core.deleteByCount.shard1.replica_p4, service url = null, agent id = null] for registry solr.core.deleteByCount.shard1.replica_p4 / com.codahale.metrics.MetricRegistry@776cdefd
   [junit4]   2> 404300 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deleteByCount_shard1_replica_p4] o.a.s.c.ZkController deleteByCount_shard1_replica_p4 stopping background replication from leader
   [junit4]   2> 404301 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deleteByCount_shard1_replica_p4] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p4]  CLOSING SolrCore org.apache.solr.core.SolrCore@15f37e83
   [junit4]   2> 404301 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deleteByCount_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.deleteByCount.shard1.replica_p4, tag=15f37e83
   [junit4]   2> 404301 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deleteByCount_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.deleteByCount.shard1.leader, tag=15f37e83
   [junit4]   2> 404302 INFO  (qtp556448094-5735) [n:127.0.0.1:33249_solr    x:deleteByCount_shard1_replica_p4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=deleteByCount_shard1_replica_p4&deleteMetricsHistory=true&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2&deleteIndex=true} status=0 QTime=10
   [junit4]   2> 404403 INFO  (zkCallback-1502-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 404403 INFO  (zkCallback-1518-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 404403 INFO  (zkCallback-1543-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 404504 INFO  (qtp1045458938-5620) [n:127.0.0.1:35621_solr    x:deleteByCount_shard1_replica_p2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.deleteByCount.shard1.replica_p2, tag=null
   [junit4]   2> 404504 INFO  (qtp1045458938-5620) [n:127.0.0.1:35621_solr    x:deleteByCount_shard1_replica_p2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6952b8: rootName = solr_35621, domain = solr.core.deleteByCount.shard1.replica_p2, service url = null, agent id = null] for registry solr.core.deleteByCount.shard1.replica_p2 / com.codahale.metrics.MetricRegistry@5731e333
   [junit4]   2> 404515 INFO  (qtp1045458938-5620) [n:127.0.0.1:35621_solr    x:deleteByCount_shard1_replica_p2] o.a.s.c.ZkController deleteByCount_shard1_replica_p2 stopping background replication from leader
   [junit4]   2> 404516 INFO  (qtp1045458938-5620) [n:127.0.0.1:35621_solr    x:deleteByCount_shard1_replica_p2] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p2]  CLOSING SolrCore org.apache.solr.core.SolrCore@779c1a3c
   [junit4]   2> 404516 INFO  (qtp1045458938-5620) [n:127.0.0.1:35621_solr    x:deleteByCount_shard1_replica_p2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.deleteByCount.shard1.replica_p2, tag=779c1a3c
   [junit4]   2> 404516 INFO  (qtp1045458938-5620) [n:127.0.0.1:35621_solr    x:deleteByCount_shard1_replica_p2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.deleteByCount.shard1.leader, tag=779c1a3c
   [junit4]   2> 404519 INFO  (qtp1045458938-5620) [n:127.0.0.1:35621_solr    x:deleteByCount_shard1_replica_p2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=deleteByCount_shard1_replica_p2&deleteMetricsHistory=true&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2&deleteIndex=true} status=0 QTime=14
   [junit4]   2> 404620 INFO  (zkCallback-1518-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 404620 INFO  (zkCallback-1543-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 404722 INFO  (qtp556448094-5618) [n:127.0.0.1:33249_solr c:deleteByCount   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={count=2&action=DELETEREPLICA&collection=deleteByCount&shard=shard1&wt=javabin&version=2} status=0 QTime=434
   [junit4]   2> 404723 INFO  (qtp556448094-5621) [n:127.0.0.1:33249_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletereplica with params count=1&action=DELETEREPLICA&collection=deleteByCount&shard=shard1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 404724 INFO  (OverseerCollectionConfigSetProcessor-72117909584347142-127.0.0.1:33249_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 404725 ERROR (OverseerThreadFactory-2298-thread-5) [ c:deleteByCount s:shard1  ] o.a.s.c.a.c.OverseerCollectionMessageHandler Collection: deleteByCount operation: deletereplica failed:org.apache.solr.common.SolrException: There is only one replica available in shard/collection: shard1/deleteByCount. Cannot delete that.
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.DeleteReplicaCmd.validateReplicaAvailability(DeleteReplicaCmd.java:191)
   [junit4]   2> 	at org.apac

[...truncated too long message...]

_true/terms/shard1
   [junit4]   2> 	13	/solr/aliases.json
   [junit4]   2> 	10	/solr/collections/deleteReplicaOnIndexing/terms/shard1
   [junit4]   2> 	8	/solr/collections/deletereplica_test/terms/shard1
   [junit4]   2> 	7	/solr/collections/deleteByCountNew/terms/shard1
   [junit4]   2> 	7	/solr/collections/delLiveColl/terms/shard2
   [junit4]   2> 	7	/solr/collections/deleteByCountNew/terms/shard2
   [junit4]   2> 	6	/solr/security.json
   [junit4]   2> 	5	/solr/collections/delLiveColl/terms/shard1
   [junit4]   2> 	5	/solr/collections/deleteByCount/terms/shard1
   [junit4]   2> 	2	/solr/collections/raceDeleteReplica_false/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	19	/solr/collections/raceDeleteReplica_true/state.json
   [junit4]   2> 	13	/solr/clusterprops.json
   [junit4]   2> 	13	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/collections/delLiveColl/state.json
   [junit4]   2> 	5	/solr/collections/deleteByCountNew/state.json
   [junit4]   2> 	4	/solr/collections/deletereplica_test/state.json
   [junit4]   2> 	4	/solr/collections/deleteByCount/state.json
   [junit4]   2> 	4	/solr/collections/deleteFromClusterState_true/state.json
   [junit4]   2> 	4	/solr/collections/deleteFromClusterState_false/state.json
   [junit4]   2> 	3	/solr/collections/deleteReplicaOnIndexing/state.json
   [junit4]   2> 	3	/solr/overseer_elect/election/72117909584347144-127.0.0.1:41227_solr-n_0000000001
   [junit4]   2> 	2	/solr/collections/deleteFromClusterState_true/leader_elect/shard1/election/72117909584347151-core_node4-n_0000000000
   [junit4]   2> 	2	/solr/autoscaling.json
   [junit4]   2> 	2	/solr/collections/raceDeleteReplica_true/leader_elect/shard1/election/72117909584347142-core_node4-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	13	/solr/live_nodes
   [junit4]   2> 	13	/solr/collections
   [junit4]   2> 	2	/solr/overseer/queue
   [junit4]   2> 	2	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	2	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	2	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_640A9F6EA21DF59-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3323096b), locale=en-TV, timezone=Mexico/General
   [junit4]   2> NOTE: Linux 4.15.0-29-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=154802088,total=510132224
   [junit4]   2> NOTE: All tests run in this JVM: [TestCustomStream, ChaosMonkeySafeLeaderTest, TestManagedStopFilterFactory, FieldAnalysisRequestHandlerTest, TestImpersonationWithHadoopAuth, OutputWriterTest, ZkSolrClientTest, DistribCursorPagingTest, CoreAdminCreateDiscoverTest, HLLSerializationTest, TestStressLucene, EmbeddedSolrNoSerializeTest, TaggerTest, NumericFieldsTest, CoreAdminRequestStatusTest, TestSolrConfigHandlerCloud, ConvertedLegacyTest, TestUseDocValuesAsStored, TestFunctionQuery, TestTrackingShardHandlerFactory, TestLargeCluster, TestSchemaManager, TestQuerySenderNoQuery, DistributedQueryComponentCustomSortTest, TestSweetSpotSimilarityFactory, TestConfigSetsAPIExclusivity, RecoveryAfterSoftCommitTest, TestMergePolicyConfig, TestScoreJoinQPNoScore, BadComponentTest, FileUtilsTest, TestLockTree, TestRecoveryHdfs, PKIAuthenticationIntegrationTest, TestRTimerTree, ShardSplitTest, TestShortCircuitedRequests, DistributedSpellCheckComponentTest, TestCloudSearcherWarming, TestSchemaNameResource, TestJsonFacetsStatsParsing, TestNamedUpdateProcessors, IndexSizeTriggerTest, TestJoin, ChangedSchemaMergeTest, TestSubQueryTransformerDistrib, TestInitParams, SpellPossibilityIteratorTest, BaseCdcrDistributedZkTest, ClusterStateUpdateTest, DeleteReplicaTest]
   [junit4] Completed [253/828 (1!)] on J2 in 165.92s, 7 tests, 1 failure <<< FAILURES!

[...truncated 2792 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.io.stream.MathExpressionTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.MathExpressionTest_F87D0365A7F86D44-001/init-core-data-001
   [junit4]   1> 05:29:24.127 [Thread-64] ERROR org.apache.zookeeper.server.ZooKeeperServer - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   1> 05:29:24.424 [jetty-launcher-298-thread-4] ERROR org.apache.solr.util.StartupLoggingUtils - Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> 05:29:24.424 [jetty-launcher-298-thread-3] ERROR org.apache.solr.util.StartupLoggingUtils - Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> 05:29:24.425 [jetty-launcher-298-thread-2] ERROR org.apache.solr.util.StartupLoggingUtils - Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> 05:29:24.425 [jetty-launcher-298-thread-1] ERROR org.apache.solr.util.StartupLoggingUtils - Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=MathExpressionTest -Dtests.method=testMultiVariateNormalDistribution -Dtests.seed=F87D0365A7F86D44 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=el -Dtests.timezone=Europe/Belfast -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.12s J1 | MathExpressionTest.testMultiVariateNormalDistribution <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: [-3.2124788454459896, 40.43704103619221]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F87D0365A7F86D44:62868A1290D12F4F]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.io.stream.MathExpressionTest.testMultiVariateNormalDistribution(MathExpressionTest.java:3010)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] IGNOR/A 0.00s J1 | MathExpressionTest.testDistributions
   [junit4]    > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028"))
   [junit4]   1> 05:29:39.029 [SUITE-MathExpressionTest-seed#[F87D0365A7F86D44]-worker] ERROR org.apache.zookeeper.server.ZooKeeperServer - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.MathExpressionTest_F87D0365A7F86D44-001
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4dc99430), locale=el, timezone=Europe/Belfast
   [junit4]   2> NOTE: Linux 4.15.0-29-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=374083928,total=527433728
   [junit4]   2> NOTE: All tests run in this JVM: [TestPolicy2, StreamExpressionTest, ModifiableSolrParamsTest, RawValueEvaluatorTest, SolrExampleXMLTest, MathExpressionTest]
   [junit4] Completed [62/155 (1!)] on J1 in 15.63s, 97 tests, 1 failure, 1 skipped <<< FAILURES!

[...truncated 41134 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/22616/consoleText

[repro] Revision: 08ca54f1f89eb98f6a3238f0f91c1f8383c12119

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line:  ant test  -Dtestcase=DeleteReplicaTest -Dtests.method=raceConditionOnDeleteAndRegisterReplica -Dtests.seed=640A9F6EA21DF59 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-TV -Dtests.timezone=Mexico/General -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1

[repro] Repro line:  ant test  -Dtestcase=MathExpressionTest -Dtests.method=testMultiVariateNormalDistribution -Dtests.seed=F87D0365A7F86D44 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=el -Dtests.timezone=Europe/Belfast -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/solrj
[repro]       MathExpressionTest
[repro]    solr/core
[repro]       DeleteReplicaTest
[repro] ant compile-test

[...truncated 2472 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.MathExpressionTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=F87D0365A7F86D44 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=el -Dtests.timezone=Europe/Belfast -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1

[...truncated 556 lines...]
[repro] ant compile-test

[...truncated 1337 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.DeleteReplicaTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=640A9F6EA21DF59 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-TV -Dtests.timezone=Mexico/General -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1

[...truncated 108 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.client.solrj.io.stream.MathExpressionTest
[repro]   0/5 failed: org.apache.solr.cloud.DeleteReplicaTest
[repro] Exiting with code 0

[...truncated 40 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_172) - Build # 22621 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/22621/
Java: 64bit/jdk1.8.0_172 -XX:+UseCompressedOops -XX:+UseSerialGC

4 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicZkTest

Error Message:
SolrCore.getOpenCount()==2

Stack Trace:
java.lang.RuntimeException: SolrCore.getOpenCount()==2
	at __randomizedtesting.SeedInfo.seed([45B66A5FF1C81659]:0)
	at org.apache.solr.util.TestHarness.close(TestHarness.java:379)
	at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:802)
	at org.apache.solr.cloud.AbstractZkTestCase.azt_afterClass(AbstractZkTestCase.java:147)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicZkTest

Error Message:
SolrCore.getOpenCount()==2

Stack Trace:
java.lang.RuntimeException: SolrCore.getOpenCount()==2
	at __randomizedtesting.SeedInfo.seed([45B66A5FF1C81659]:0)
	at org.apache.solr.util.TestHarness.close(TestHarness.java:379)
	at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:802)
	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:297)
	at sun.reflect.GeneratedMethodAccessor50.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicZkTest

Error Message:
26 threads leaked from SUITE scope at org.apache.solr.cloud.BasicZkTest:     1) Thread[id=4019, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=4042, name=Thread-680, state=WAITING, group=TGRP-BasicZkTest]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:502)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1854)    3) Thread[id=4040, name=MetricsHistoryHandler-1950-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    4) Thread[id=4055, name=SessionTracker, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Object.wait(Native Method)         at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147)    5) Thread[id=4028, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-SendThread(127.0.0.1:33595), state=RUNNABLE, group=TGRP-BasicZkTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)    6) Thread[id=4035, name=ScheduledTrigger-1945-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    7) Thread[id=4032, name=OverseerAutoScalingTriggerThread-72120053600813059-88.99.242.108:8983_-n_0000000000, state=WAITING, group=Overseer autoscaling triggers]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:189)         at java.lang.Thread.run(Thread.java:748)    8) Thread[id=4038, name=ScheduledTrigger-1945-thread-4, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    9) Thread[id=4039, name=SolrRrdBackendFactory-1949-thread-1, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   10) Thread[id=4057, name=ProcessThread(sid:0 cport:33595):, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)   11) Thread[id=4023, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-SendThread(127.0.0.1:33595), state=RUNNABLE, group=TGRP-BasicZkTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)   12) Thread[id=4024, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-EventThread, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   13) Thread[id=4036, name=ScheduledTrigger-1945-thread-2, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   14) Thread[id=4045, name=searcherExecutor-1952-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   15) Thread[id=4017, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   16) Thread[id=4029, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-EventThread, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   17) Thread[id=4026, name=OverseerStateUpdate-72120053600813059-88.99.242.108:8983_-n_0000000000, state=TIMED_WAITING, group=Overseer state updater.]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)         at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:205)         at java.lang.Thread.run(Thread.java:748)   18) Thread[id=4054, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:33595, state=RUNNABLE, group=TGRP-BasicZkTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)         at java.lang.Thread.run(Thread.java:748)   19) Thread[id=4027, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   20) Thread[id=4053, name=Thread-681, state=WAITING, group=TGRP-BasicZkTest]         at java.lang.Object.wait(Native Method)         at java.lang.Thread.join(Thread.java:1252)         at java.lang.Thread.join(Thread.java:1326)         at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)         at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)         at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496)   21) Thread[id=4062, name=SolrRrdBackendFactory-1949-thread-2, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   22) Thread[id=4037, name=ScheduledTrigger-1945-thread-3, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   23) Thread[id=4030, name=zkConnectionManagerCallback-992-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   24) Thread[id=4031, name=OverseerCollectionConfigSetProcessor-72120053600813059-88.99.242.108:8983_-n_0000000000, state=TIMED_WAITING, group=Overseer collection creation process.]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)         at org.apache.solr.cloud.OverseerTaskQueue.peekTopN(OverseerTaskQueue.java:243)         at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:228)         at java.lang.Thread.run(Thread.java:748)   25) Thread[id=4025, name=zkConnectionManagerCallback-985-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   26) Thread[id=4018, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 26 threads leaked from SUITE scope at org.apache.solr.cloud.BasicZkTest: 
   1) Thread[id=4019, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=4042, name=Thread-680, state=WAITING, group=TGRP-BasicZkTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at org.apache.solr.core.CloserThread.run(CoreContainer.java:1854)
   3) Thread[id=4040, name=MetricsHistoryHandler-1950-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   4) Thread[id=4055, name=SessionTracker, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Object.wait(Native Method)
        at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147)
   5) Thread[id=4028, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-SendThread(127.0.0.1:33595), state=RUNNABLE, group=TGRP-BasicZkTest]
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   6) Thread[id=4035, name=ScheduledTrigger-1945-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   7) Thread[id=4032, name=OverseerAutoScalingTriggerThread-72120053600813059-88.99.242.108:8983_-n_0000000000, state=WAITING, group=Overseer autoscaling triggers]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:189)
        at java.lang.Thread.run(Thread.java:748)
   8) Thread[id=4038, name=ScheduledTrigger-1945-thread-4, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   9) Thread[id=4039, name=SolrRrdBackendFactory-1949-thread-1, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  10) Thread[id=4057, name=ProcessThread(sid:0 cport:33595):, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)
  11) Thread[id=4023, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-SendThread(127.0.0.1:33595), state=RUNNABLE, group=TGRP-BasicZkTest]
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
  12) Thread[id=4024, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-EventThread, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
  13) Thread[id=4036, name=ScheduledTrigger-1945-thread-2, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  14) Thread[id=4045, name=searcherExecutor-1952-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  15) Thread[id=4017, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
  16) Thread[id=4029, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-EventThread, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
  17) Thread[id=4026, name=OverseerStateUpdate-72120053600813059-88.99.242.108:8983_-n_0000000000, state=TIMED_WAITING, group=Overseer state updater.]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)
        at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:205)
        at java.lang.Thread.run(Thread.java:748)
  18) Thread[id=4054, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:33595, state=RUNNABLE, group=TGRP-BasicZkTest]
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
        at java.lang.Thread.run(Thread.java:748)
  19) Thread[id=4027, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
  20) Thread[id=4053, name=Thread-681, state=WAITING, group=TGRP-BasicZkTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1252)
        at java.lang.Thread.join(Thread.java:1326)
        at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)
        at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)
        at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496)
  21) Thread[id=4062, name=SolrRrdBackendFactory-1949-thread-2, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  22) Thread[id=4037, name=ScheduledTrigger-1945-thread-3, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  23) Thread[id=4030, name=zkConnectionManagerCallback-992-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  24) Thread[id=4031, name=OverseerCollectionConfigSetProcessor-72120053600813059-88.99.242.108:8983_-n_0000000000, state=TIMED_WAITING, group=Overseer collection creation process.]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)
        at org.apache.solr.cloud.OverseerTaskQueue.peekTopN(OverseerTaskQueue.java:243)
        at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:228)
        at java.lang.Thread.run(Thread.java:748)
  25) Thread[id=4025, name=zkConnectionManagerCallback-985-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  26) Thread[id=4018, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([45B66A5FF1C81659]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=4042, name=Thread-680, state=WAITING, group=TGRP-BasicZkTest]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:502)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1854)    2) Thread[id=4040, name=MetricsHistoryHandler-1950-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    3) Thread[id=4028, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-SendThread(127.0.0.1:33595), state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    4) Thread[id=4035, name=ScheduledTrigger-1945-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    5) Thread[id=4062, name=SolrRrdBackendFactory-1949-thread-2, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    6) Thread[id=4037, name=ScheduledTrigger-1945-thread-3, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    7) Thread[id=4030, name=zkConnectionManagerCallback-992-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    8) Thread[id=4038, name=ScheduledTrigger-1945-thread-4, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    9) Thread[id=4025, name=zkConnectionManagerCallback-985-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   10) Thread[id=4039, name=SolrRrdBackendFactory-1949-thread-1, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   11) Thread[id=4023, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-SendThread(127.0.0.1:33595), state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)   12) Thread[id=4036, name=ScheduledTrigger-1945-thread-2, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   13) Thread[id=4045, name=searcherExecutor-1952-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=4042, name=Thread-680, state=WAITING, group=TGRP-BasicZkTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at org.apache.solr.core.CloserThread.run(CoreContainer.java:1854)
   2) Thread[id=4040, name=MetricsHistoryHandler-1950-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   3) Thread[id=4028, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-SendThread(127.0.0.1:33595), state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   4) Thread[id=4035, name=ScheduledTrigger-1945-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   5) Thread[id=4062, name=SolrRrdBackendFactory-1949-thread-2, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   6) Thread[id=4037, name=ScheduledTrigger-1945-thread-3, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   7) Thread[id=4030, name=zkConnectionManagerCallback-992-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   8) Thread[id=4038, name=ScheduledTrigger-1945-thread-4, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   9) Thread[id=4025, name=zkConnectionManagerCallback-985-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  10) Thread[id=4039, name=SolrRrdBackendFactory-1949-thread-1, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  11) Thread[id=4023, name=SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker-SendThread(127.0.0.1:33595), state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
  12) Thread[id=4036, name=ScheduledTrigger-1945-thread-2, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  13) Thread[id=4045, name=searcherExecutor-1952-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([45B66A5FF1C81659]:0)




Build Log:
[...truncated 12755 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicZkTest
   [junit4]   2> 419753 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.BasicZkTest_45B66A5FF1C81659-001/init-core-data-001
   [junit4]   2> 419753 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 419755 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 419755 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 419755 INFO  (Thread-679) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 419755 INFO  (Thread-679) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 419756 ERROR (Thread-679) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 419855 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:33595
   [junit4]   2> 419857 INFO  (zkConnectionManagerCallback-977-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 419860 INFO  (zkConnectionManagerCallback-979-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 419863 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 419879 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 419880 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 419881 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 419881 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 419882 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 419883 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 419884 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 419884 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 419885 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 419886 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 419887 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 419887 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 419908 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 419921 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 419993 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 420054 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33595/solr
   [junit4]   2> 420055 INFO  (zkConnectionManagerCallback-983-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 420058 INFO  (zkConnectionManagerCallback-985-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 420107 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [n:88.99.242.108:8983_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 88.99.242.108:8983_
   [junit4]   2> 420107 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [n:88.99.242.108:8983_    ] o.a.s.c.Overseer Overseer (id=72120053600813059-88.99.242.108:8983_-n_0000000000) starting
   [junit4]   2> 420112 INFO  (zkConnectionManagerCallback-992-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 420113 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [n:88.99.242.108:8983_    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33595/solr ready
   [junit4]   2> 420114 INFO  (OverseerStateUpdate-72120053600813059-88.99.242.108:8983_-n_0000000000) [    ] o.a.s.c.Overseer Starting to work on the main queue : 88.99.242.108:8983_
   [junit4]   2> 420117 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [n:88.99.242.108:8983_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/88.99.242.108:8983_
   [junit4]   2> 420121 INFO  (zkCallback-991-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 420121 INFO  (zkCallback-984-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 420133 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [n:88.99.242.108:8983_    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 420148 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [n:88.99.242.108:8983_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e83c213
   [junit4]   2> 420155 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [n:88.99.242.108:8983_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e83c213
   [junit4]   2> 420155 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [n:88.99.242.108:8983_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e83c213
   [junit4]   2> 420157 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 421160 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 421177 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 421190 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 421251 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 421270 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1, trusted=true
   [junit4]   2> 421270 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.88.99.242.108:8983__collection1' (registry 'solr.core.collection1.shard1.88.99.242.108:8983__collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e83c213
   [junit4]   2> 421270 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 421270 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.BasicZkTest_45B66A5FF1C81659-001/init-core-data-001/]
   [junit4]   2> 421272 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=42.73828125, floorSegmentMB=0.96484375, forceMergeDeletesPctAllowed=3.6328365105256513, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=31.445197028495876
   [junit4]   2> 421316 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 421316 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 421317 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 421317 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 421318 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 421318 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7017198f[collection1] main]
   [junit4]   2> 421319 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 421576 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 421671 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 421671 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 421671 INFO  (coreLoadExecutor-1951-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1608149394357485568
   [junit4]   2> 421671 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 421671 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 421671 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 421672 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 421672 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 421672 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 421672 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 421672 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 421673 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7017198f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 421675 INFO  (coreZkRegister-1939-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 r:88.99.242.108:8983__collection1 x:collection1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={88.99.242.108:8983__collection1=0}, version=0}
   [junit4]   2> 421676 INFO  (coreZkRegister-1939-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 r:88.99.242.108:8983__collection1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 421676 INFO  (SUITE-BasicZkTest-seed#[45B66A5FF1C81659]-worker) [n:88.99.242.108:8983_    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 421676 INFO  (coreZkRegister-1939-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 r:88.99.242.108:8983__collection1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 421676 INFO  (coreZkRegister-1939-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 r:88.99.242.108:8983__collection1 x:collection1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 421681 INFO  (coreZkRegister-1939-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 r:88.99.242.108:8983__collection1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://88.99.242.108:8983/collection1/ shard1
   [junit4]   2> 421683 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.SolrTestCaseJ4 ###Starting testBasic
   [junit4]   2> 421784 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=qlkciyopsbgzyvkylsjhchghjrdf&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
   [junit4]   2> 421787 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={88.99.242.108:8983__collection1=1}, version=1}
   [junit4]   2> 421787 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{delete=[42 (-1608149394478071808)]} 0 1
   [junit4]   2> 421788 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[42 (1608149394480168960)]} 0 0
   [junit4]   2> 421789 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1608149394481217536,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 421789 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1a517c99 commitCommandVersion:1608149394481217536
   [junit4]   2> 421793 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@65be611e[collection1] main]
   [junit4]   2> 421793 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 421795 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@65be611e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):c1)))}
   [junit4]   2> 421795 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 6
   [junit4]   2> 421798 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:42+AND+val_s:aa\;bb&qt=&start=0&rows=20&version=2.2} hits=1 status=0 QTime=2
   [junit4]   2> 421799 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:42+AND+val_s:"aa;bb"&qt=&start=0&rows=20&version=2.2} hits=1 status=0 QTime=0
   [junit4]   2> 421800 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:42+AND+val_s:aa&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
   [junit4]   2> 421801 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{delete=[42 (-1608149394492751872)]} 0 0
   [junit4]   2> 421801 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1608149394493800448,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 421802 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1a517c99 commitCommandVersion:1608149394493800448
   [junit4]   2> 421802 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@394466be[collection1] main]
   [junit4]   2> 421803 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 421804 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@394466be[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 421804 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 2
   [junit4]   2> 421805 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:42&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
   [junit4]   2> 421806 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[42 (1608149394497994752)]} 0 1
   [junit4]   2> 421807 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[42 (1608149394500091904)]} 0 0
   [junit4]   2> 421807 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1608149394500091905,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 421807 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1a517c99 commitCommandVersion:1608149394500091905
   [junit4]   2> 421811 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1f9f6921[collection1] main]
   [junit4]   2> 421811 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 421813 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1f9f6921[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(8.0.0):c2/1:delGen=1)))}
   [junit4]   2> 421813 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 6
   [junit4]   2> 421814 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:42&qt=&start=0&rows=20&version=2.2} hits=1 status=0 QTime=0
   [junit4]   2> 421816 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[42 (1608149394508480512)]} 0 1
   [junit4]   2> 421816 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[42 (1608149394509529088)]} 0 0
   [junit4]   2> 421817 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1608149394510577664,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 421817 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1a517c99 commitCommandVersion:1608149394510577664
   [junit4]   2> 421820 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@743c1fbe[collection1] main]
   [junit4]   2> 421821 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 421822 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@743c1fbe[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(8.0.0):c2/1:delGen=1)))}
   [junit4]   2> 421822 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 5
   [junit4]   2> 421823 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:42&qt=&start=0&rows=20&version=2.2} hits=1 status=0 QTime=0
   [junit4]   2> 421825 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[101 (1608149394517917696)]} 0 1
   [junit4]   2> 421826 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[101 (1608149394520014848)]} 0 0
   [junit4]   2> 421826 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[105 (1608149394520014849)]} 0 0
   [junit4]   2> 421827 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[102 (1608149394520014850)]} 0 0
   [junit4]   2> 421827 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[103 (1608149394521063424)]} 0 0
   [junit4]   2> 421827 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[101 (1608149394521063425)]} 0 0
   [junit4]   2> 421827 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1608149394521063426,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 421827 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1a517c99 commitCommandVersion:1608149394521063426
   [junit4]   2> 421830 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@eecab09[collection1] main]
   [junit4]   2> 421831 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 421832 INFO  (searcherExecutor-1952-thread-1-processing-n:88.99.242.108:8983_) [n:88.99.242.108:8983_    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@eecab09[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(8.0.0):c2/1:delGen=1) Uninverting(_3(8.0.0):c6/2:delGen=1)))}
   [junit4]   2> 421832 WARN  (coreZkRegister-1939-thread-1-processing-n:88.99.242.108:8983_ x:collection1 c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 r:88.99.242.108:8983__collection1 x:collection1] o.a.s.c.ZkController Skipping recovery according to sys prop solrcloud.skip.autorecovery
   [junit4]   2> 421832 INFO  (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 5
   [junit4]   2> 421833 ERROR (TEST-BasicZkTest.testBasic-seed#[45B66A5FF1C81659]) [n:88.99.242.108:8983_    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server wo

[...truncated too long message...]

ns/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

init:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

compile-core:

init:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

common.compile-core:
    [javac] Compiling 3 source files to /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/java

common-solr.compile-core:

compile-core:

compile-test-framework:

-check-git-state:

-git-cleanroot:

-copy-git-state:

git-autoclean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

init:

compile-lucene-core:

compile-codecs:

-check-git-state:

-git-cleanroot:

-copy-git-state:

git-autoclean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

common.init:

compile-lucene-core:

init:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

compile-core:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

common.compile-core:

compile-core:

common.compile-test:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/test
    [javac] Compiling 926 source files to /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/test
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/test/org/apache/solr/cloud/autoscaling/sim/package-info.class
     [copy] Copying 1 file to /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/test

common-solr.compile-test:

compile-test:

BUILD SUCCESSFUL
Total time: 55 seconds
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.BasicZkTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=45B66A5FF1C81659 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es-DO -Dtests.timezone=Australia/Victoria -Dtests.asserts=true -Dtests.file.encoding=UTF-8
Buildfile: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/build.xml

-clover.disable:

ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

install-junit4-taskdef:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 18ms :: artifacts dl 1ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
	---------------------------------------------------------------------

-init-totals:

-test:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: 45B66A5FF1C81659
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp
   [junit4] <JUnit4> says salut! Master seed: 45B66A5FF1C81659
   [junit4] Executing 5 suites with 3 JVMs.
   [junit4] 
   [junit4] Started J0 PID(13523@serv1.sd-datasolutions.de).
   [junit4] Started J2 PID(13524@serv1.sd-datasolutions.de).
   [junit4] Started J1 PID(13525@serv1.sd-datasolutions.de).
   [junit4] Suite: org.apache.solr.cloud.BasicZkTest
   [junit4] OK      3.03s J0 | BasicZkTest.testBasic
   [junit4] Completed [1/5] on J0 in 11.77s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.BasicZkTest
   [junit4] OK      3.68s J2 | BasicZkTest.testBasic
   [junit4] Completed [2/5] on J2 in 12.80s, 1 test
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.BasicZkTest. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.cloud.BasicZkTest
   [junit4] OK      2.54s J1 | BasicZkTest.testBasic
   [junit4] Completed [3/5] on J1 in 13.89s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.BasicZkTest
   [junit4] OK      1.64s J0 | BasicZkTest.testBasic
   [junit4] Completed [4/5] on J0 in 6.75s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.BasicZkTest
   [junit4] OK      1.94s J2 | BasicZkTest.testBasic
   [junit4] Completed [5/5] on J2 in 6.91s, 1 test
   [junit4] 
   [junit4] JVM J0:     0.43 ..    20.07 =    19.64s
   [junit4] JVM J1:     0.46 ..    15.25 =    14.79s
   [junit4] JVM J2:     0.44 ..    21.26 =    20.82s
   [junit4] Execution time total: 21 seconds
   [junit4] Tests summary: 5 suites, 5 tests
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp])
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp])
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp])
     [echo] 5 slowest tests:
[junit4:tophints] 108.10s | org.apache.solr.cloud.TestTlogReplica
[junit4:tophints] 104.73s | org.apache.solr.cloud.MetricsHistoryIntegrationTest
[junit4:tophints]  91.84s | org.apache.solr.cloud.TestPullReplicaErrorHandling
[junit4:tophints]  90.69s | org.apache.solr.cloud.TestPullReplica
[junit4:tophints]  74.24s | org.apache.solr.request.TestIntervalFaceting

-check-totals:

test-nocompile:

BUILD SUCCESSFUL
Total time: 23 seconds
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.BasicZkTest
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
	at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2845)
	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2724)
	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2705)
	at hudson.FilePath.act(FilePath.java:1076)
	at hudson.FilePath.act(FilePath.java:1059)
	at hudson.FilePath.validateAntFileMask(FilePath.java:2703)
	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
	at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
	at hudson.model.Build$BuildExecution.post2(Build.java:186)
	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
	at hudson.model.Run.execute(Run.java:1840)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=3898653195b24987b8ba53ea9acf8713316b66f3, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #22620
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-10.0.1) - Build # 22620 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/22620/
Java: 64bit/jdk-10.0.1 -XX:+UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.TestWithCollection.testDeleteWithCollection

Error Message:
Error from server at https://127.0.0.1:33223/solr: Could not find collection : testDeleteWithCollection_abc

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:33223/solr: Could not find collection : testDeleteWithCollection_abc
	at __randomizedtesting.SeedInfo.seed([EF87C5A37A165324:945E324E238C819A]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.TestWithCollection.testDeleteWithCollection(TestWithCollection.java:197)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestWithCollection.testDeleteWithCollection

Error Message:
Error from server at https://127.0.0.1:33911/solr: Could not find collection : testDeleteWithCollection_abc_2

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:33911/solr: Could not find collection : testDeleteWithCollection_abc_2
	at __randomizedtesting.SeedInfo.seed([EF87C5A37A165324:945E324E238C819A]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.TestWithCollection.testDeleteWithCollection(TestWithCollection.java:224)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 14110 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestWithCollection
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/init-core-data-001
   [junit4]   2> 1406133 INFO  (SUITE-TestWithCollection-seed#[EF87C5A37A165324]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1406134 INFO  (SUITE-TestWithCollection-seed#[EF87C5A37A165324]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 1406134 INFO  (SUITE-TestWithCollection-seed#[EF87C5A37A165324]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1406135 INFO  (SUITE-TestWithCollection-seed#[EF87C5A37A165324]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001
   [junit4]   2> 1406135 INFO  (SUITE-TestWithCollection-seed#[EF87C5A37A165324]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1406135 INFO  (Thread-4541) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1406135 INFO  (Thread-4541) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1406136 ERROR (Thread-4541) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1406235 INFO  (SUITE-TestWithCollection-seed#[EF87C5A37A165324]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:42963
   [junit4]   2> 1406236 INFO  (zkConnectionManagerCallback-8704-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1406239 INFO  (jetty-launcher-8701-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 10.0.1+10
   [junit4]   2> 1406239 INFO  (jetty-launcher-8701-thread-2) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 10.0.1+10
   [junit4]   2> 1406240 INFO  (jetty-launcher-8701-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1406240 INFO  (jetty-launcher-8701-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1406240 INFO  (jetty-launcher-8701-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1406240 INFO  (jetty-launcher-8701-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1406240 INFO  (jetty-launcher-8701-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1406240 INFO  (jetty-launcher-8701-thread-2) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1406241 INFO  (jetty-launcher-8701-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4ef5389d{/solr,null,AVAILABLE}
   [junit4]   2> 1406241 INFO  (jetty-launcher-8701-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@34ce067{/solr,null,AVAILABLE}
   [junit4]   2> 1406243 INFO  (jetty-launcher-8701-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@544f703d{SSL,[ssl, http/1.1]}{127.0.0.1:41503}
   [junit4]   2> 1406243 INFO  (jetty-launcher-8701-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@36c1b820{SSL,[ssl, http/1.1]}{127.0.0.1:33911}
   [junit4]   2> 1406243 INFO  (jetty-launcher-8701-thread-2) [    ] o.e.j.s.Server Started @1406277ms
   [junit4]   2> 1406243 INFO  (jetty-launcher-8701-thread-1) [    ] o.e.j.s.Server Started @1406277ms
   [junit4]   2> 1406243 INFO  (jetty-launcher-8701-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41503}
   [junit4]   2> 1406243 INFO  (jetty-launcher-8701-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33911}
   [junit4]   2> 1406244 ERROR (jetty-launcher-8701-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1406244 ERROR (jetty-launcher-8701-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1406244 INFO  (jetty-launcher-8701-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1406244 INFO  (jetty-launcher-8701-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1406244 INFO  (jetty-launcher-8701-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 1406244 INFO  (jetty-launcher-8701-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 1406244 INFO  (jetty-launcher-8701-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1406244 INFO  (jetty-launcher-8701-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1406244 INFO  (jetty-launcher-8701-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1406244 INFO  (jetty-launcher-8701-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1406244 INFO  (jetty-launcher-8701-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-08-07T11:27:38.460222Z
   [junit4]   2> 1406244 INFO  (jetty-launcher-8701-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-08-07T11:27:38.460228Z
   [junit4]   2> 1406245 INFO  (zkConnectionManagerCallback-8707-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1406245 INFO  (zkConnectionManagerCallback-8708-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1406245 INFO  (jetty-launcher-8701-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1406245 INFO  (jetty-launcher-8701-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1406248 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100383d53b30002, likely client has closed socket
   [junit4]   2> 1406277 INFO  (jetty-launcher-8701-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42963/solr
   [junit4]   2> 1406278 INFO  (zkConnectionManagerCallback-8712-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1406279 INFO  (zkConnectionManagerCallback-8714-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1406308 INFO  (jetty-launcher-8701-thread-1) [n:127.0.0.1:33911_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33911_solr
   [junit4]   2> 1406308 INFO  (jetty-launcher-8701-thread-1) [n:127.0.0.1:33911_solr    ] o.a.s.c.Overseer Overseer (id=72119430086328324-127.0.0.1:33911_solr-n_0000000000) starting
   [junit4]   2> 1406311 INFO  (zkConnectionManagerCallback-8721-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1406312 INFO  (jetty-launcher-8701-thread-1) [n:127.0.0.1:33911_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42963/solr ready
   [junit4]   2> 1406312 INFO  (OverseerStateUpdate-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:33911_solr
   [junit4]   2> 1406312 INFO  (jetty-launcher-8701-thread-1) [n:127.0.0.1:33911_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33911_solr
   [junit4]   2> 1406312 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 1406312 INFO  (OverseerStateUpdate-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1406312 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 1406313 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 1406313 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 1406313 INFO  (zkCallback-8720-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1406314 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:33911_solr]
   [junit4]   2> 1406314 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1406314 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 1406314 DEBUG (ScheduledTrigger-6586-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 1406320 INFO  (jetty-launcher-8701-thread-1) [n:127.0.0.1:33911_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1406323 INFO  (jetty-launcher-8701-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42963/solr
   [junit4]   2> 1406324 INFO  (zkConnectionManagerCallback-8726-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1406325 INFO  (zkConnectionManagerCallback-8728-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1406328 INFO  (jetty-launcher-8701-thread-2) [n:127.0.0.1:41503_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1406329 INFO  (jetty-launcher-8701-thread-2) [n:127.0.0.1:41503_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1406329 INFO  (jetty-launcher-8701-thread-2) [n:127.0.0.1:41503_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41503_solr
   [junit4]   2> 1406330 INFO  (zkCallback-8720-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1406330 INFO  (zkCallback-8713-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1406330 INFO  (zkCallback-8727-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1406331 INFO  (jetty-launcher-8701-thread-1) [n:127.0.0.1:33911_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33911.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@603c9810
   [junit4]   2> 1406336 INFO  (jetty-launcher-8701-thread-1) [n:127.0.0.1:33911_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33911.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@603c9810
   [junit4]   2> 1406336 INFO  (jetty-launcher-8701-thread-1) [n:127.0.0.1:33911_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33911.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@603c9810
   [junit4]   2> 1406336 INFO  (jetty-launcher-8701-thread-1) [n:127.0.0.1:33911_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/.
   [junit4]   2> 1406337 INFO  (zkConnectionManagerCallback-8735-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1406338 INFO  (jetty-launcher-8701-thread-2) [n:127.0.0.1:41503_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1406339 INFO  (jetty-launcher-8701-thread-2) [n:127.0.0.1:41503_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42963/solr ready
   [junit4]   2> 1406339 INFO  (jetty-launcher-8701-thread-2) [n:127.0.0.1:41503_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1406352 INFO  (jetty-launcher-8701-thread-2) [n:127.0.0.1:41503_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41503.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@603c9810
   [junit4]   2> 1406360 INFO  (jetty-launcher-8701-thread-2) [n:127.0.0.1:41503_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41503.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@603c9810
   [junit4]   2> 1406360 INFO  (jetty-launcher-8701-thread-2) [n:127.0.0.1:41503_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41503.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@603c9810
   [junit4]   2> 1406361 INFO  (jetty-launcher-8701-thread-2) [n:127.0.0.1:41503_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node2/.
   [junit4]   2> 1406377 INFO  (zkConnectionManagerCallback-8738-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1406379 INFO  (zkConnectionManagerCallback-8743-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1406380 INFO  (SUITE-TestWithCollection-seed#[EF87C5A37A165324]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1406381 INFO  (SUITE-TestWithCollection-seed#[EF87C5A37A165324]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42963/solr ready
   [junit4]   2> 1406387 INFO  (TEST-TestWithCollection.testMoveReplicaWithCollection-seed#[EF87C5A37A165324]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMoveReplicaWithCollection
   [junit4]   2> 1406388 DEBUG (zkCallback-8720-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 1406388 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 1406389 INFO  (TEST-TestWithCollection.testMoveReplicaWithCollection-seed#[EF87C5A37A165324]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1406389 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1406390 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1406390 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 1406404 INFO  (qtp444998032-24472) [n:127.0.0.1:33911_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1406415 INFO  (qtp1707284511-24469) [n:127.0.0.1:41503_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1406415 DEBUG (qtp444998032-24468) [n:127.0.0.1:33911_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1406416 INFO  (qtp444998032-24468) [n:127.0.0.1:33911_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=14
   [junit4]   2> 1406416 DEBUG (zkCallback-8720-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 1406416 INFO  (TEST-TestWithCollection.testMoveReplicaWithCollection-seed#[EF87C5A37A165324]) [    ] o.a.s.c.TestWithCollection Chosen node 127.0.0.1:33911_solr for collection testMoveReplicaWithCollection_abc
   [junit4]   2> 1406416 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 1406416 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1406416 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1406416 DEBUG (OverseerAutoScalingTriggerThread-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 1406416 INFO  (qtp444998032-24470) [n:127.0.0.1:33911_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&name=testMoveReplicaWithCollection_abc&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&createNodeSet=127.0.0.1:33911_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1406417 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection testMoveReplicaWithCollection_abc
   [junit4]   2> 1406417 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/protwords.txt
   [junit4]   2> 1406418 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/managed-schema
   [junit4]   2> 1406418 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/solrconfig.xml
   [junit4]   2> 1406419 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/synonyms.txt
   [junit4]   2> 1406420 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/stopwords.txt
   [junit4]   2> 1406420 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/contractions_it.txt
   [junit4]   2> 1406421 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stemdict_nl.txt
   [junit4]   2> 1406421 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_hy.txt
   [junit4]   2> 1406422 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_no.txt
   [junit4]   2> 1406422 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/contractions_ca.txt
   [junit4]   2> 1406423 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_id.txt
   [junit4]   2> 1406423 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_ga.txt
   [junit4]   2> 1406424 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_hi.txt
   [junit4]   2> 1406424 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_da.txt
   [junit4]   2> 1406425 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_ja.txt
   [junit4]   2> 1406425 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_pt.txt
   [junit4]   2> 1406426 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_hu.txt
   [junit4]   2> 1406426 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_el.txt
   [junit4]   2> 1406427 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_ru.txt
   [junit4]   2> 1406427 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_tr.txt
   [junit4]   2> 1406428 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_ar.txt
   [junit4]   2> 1406428 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/userdict_ja.txt
   [junit4]   2> 1406429 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_eu.txt
   [junit4]   2> 1406429 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_it.txt
   [junit4]   2> 1406430 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_cz.txt
   [junit4]   2> 1406431 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stoptags_ja.txt
   [junit4]   2> 1406431 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/contractions_fr.txt
   [junit4]   2> 1406432 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_de.txt
   [junit4]   2> 1406433 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_fa.txt
   [junit4]   2> 1406433 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/contractions_ga.txt
   [junit4]   2> 1406434 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_ca.txt
   [junit4]   2> 1406434 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_nl.txt
   [junit4]   2> 1406435 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_bg.txt
   [junit4]   2> 1406435 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_lv.txt
   [junit4]   2> 1406436 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_en.txt
   [junit4]   2> 1406437 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_es.txt
   [junit4]   2> 1406437 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_th.txt
   [junit4]   2> 1406438 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_ro.txt
   [junit4]   2> 1406438 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_fr.txt
   [junit4]   2> 1406439 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_sv.txt
   [junit4]   2> 1406439 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_fi.txt
   [junit4]   2> 1406440 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/hyphenations_ga.txt
   [junit4]   2> 1406440 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/lang/stopwords_gl.txt
   [junit4]   2> 1406441 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/params.json
   [junit4]   2> 1406545 DEBUG (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 1406547 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1406548 INFO  (qtp1707284511-24471) [n:127.0.0.1:41503_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1406548 DEBUG (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 1406549 INFO  (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 943543633 sessionWrapper.createTime 943543632198490, this.sessionWrapper.createTime 943543632198490 
   [junit4]   2> 1406552 INFO  (OverseerStateUpdate-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testMoveReplicaWithCollection_abc",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testMoveReplicaWithCollection_abc_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33911/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1406755 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr    x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=testMoveReplicaWithCollection_abc.AUTOCREATED&newCollection=true&name=testMoveReplicaWithCollection_abc_shard1_replica_n1&action=CREATE&numShards=1&collection=testMoveReplicaWithCollection_abc&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1406756 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr    x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1407764 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 1407764 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 1407765 WARN  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../contrib/extraction/lib
   [junit4]   2> 1407765 WARN  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../dist
   [junit4]   2> 1407765 WARN  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../contrib/clustering/lib
   [junit4]   2> 1407765 WARN  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../dist
   [junit4]   2> 1407765 WARN  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../contrib/langid/lib
   [junit4]   2> 1407765 WARN  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../dist
   [junit4]   2> 1407765 WARN  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../contrib/velocity/lib
   [junit4]   2> 1407765 WARN  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../dist
   [junit4]   2> 1407765 WARN  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../dist filtered by solr-ltr-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1/../../../../dist
   [junit4]   2> 1407770 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1407783 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.s.IndexSchema [testMoveReplicaWithCollection_abc_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 1407880 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 1407894 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testMoveReplicaWithCollection_abc_shard1_replica_n1' using configuration from collection testMoveReplicaWithCollection_abc, trusted=true
   [junit4]   2> 1407894 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33911.solr.core.testMoveReplicaWithCollection_abc.shard1.replica_n1' (registry 'solr.core.testMoveReplicaWithCollection_abc.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@603c9810
   [junit4]   2> 1407894 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1407894 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrCore [[testMoveReplicaWithCollection_abc_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_abc_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/./testMoveReplicaWithCollection_abc_shard1_replica_n1/data/]
   [junit4]   2> 1407897 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 1407940 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1407940 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1407941 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 1407941 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1407942 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@f3c6746[testMoveReplicaWithCollection_abc_shard1_replica_n1] main]
   [junit4]   2> 1407943 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/testMoveReplicaWithCollection_abc.AUTOCREATED
   [junit4]   2> 1407944 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/testMoveReplicaWithCollection_abc.AUTOCREATED
   [junit4]   2> 1407944 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/testMoveReplicaWithCollection_abc.AUTOCREATED/managed-schema
   [junit4]   2> 1407944 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1407944 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 1407945 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 1407946 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1407946 INFO  (searcherExecutor-6600-thread-1-processing-n:127.0.0.1:33911_solr x:testMoveReplicaWithCollection_abc_shard1_replica_n1 c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@f3c6746[testMoveReplicaWithCollection_abc_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1407946 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1608139418015629312
   [junit4]   2> 1407946 INFO  (searcherExecutor-6600-thread-1-processing-n:127.0.0.1:33911_solr x:testMoveReplicaWithCollection_abc_shard1_replica_n1 c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 1407946 INFO  (searcherExecutor-6600-thread-1-processing-n:127.0.0.1:33911_solr x:testMoveReplicaWithCollection_abc_shard1_replica_n1 c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 1407947 INFO  (searcherExecutor-6600-thread-1-processing-n:127.0.0.1:33911_solr x:testMoveReplicaWithCollection_abc_shard1_replica_n1 c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SolrCore [testMoveReplicaWithCollection_abc_shard1_replica_n1] Registered new searcher Searcher@f3c6746[testMoveReplicaWithCollection_abc_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1407950 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testMoveReplicaWithCollection_abc/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 1407951 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1407951 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1407951 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:33911/solr/testMoveReplicaWithCollection_abc_shard1_replica_n1/
   [junit4]   2> 1407951 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1407951 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:33911/solr/testMoveReplicaWithCollection_abc_shard1_replica_n1/ has no replicas
   [junit4]   2> 1407951 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1407953 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:33911/solr/testMoveReplicaWithCollection_abc_shard1_replica_n1/ shard1
   [junit4]   2> 1408055 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1408057 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_abc s:shard1 r:core_node2 x:testMoveReplicaWithCollection_abc_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=testMoveReplicaWithCollection_abc.AUTOCREATED&newCollection=true&name=testMoveReplicaWithCollection_abc_shard1_replica_n1&action=CREATE&numShards=1&collection=testMoveReplicaWithCollection_abc&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1301
   [junit4]   2> 1408057 DEBUG (OverseerThreadFactory-6588-thread-1) [    ] o.a.s.c.s.c.a.PolicyHelper session set to NULL
   [junit4]   2> 1408059 INFO  (qtp444998032-24470) [n:127.0.0.1:33911_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1408156 INFO  (zkCallback-8713-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMoveReplicaWithCollection_abc/state.json] for collection [testMoveReplicaWithCollection_abc] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1408418 INFO  (OverseerCollectionConfigSetProcessor-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1409059 INFO  (qtp444998032-24470) [n:127.0.0.1:33911_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&name=testMoveReplicaWithCollection_abc&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&createNodeSet=127.0.0.1:33911_solr&wt=javabin&version=2} status=0 QTime=2642
   [junit4]   2> 1409059 INFO  (qtp444998032-24468) [n:127.0.0.1:33911_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&withCollection=testMoveReplicaWithCollection_abc&name=testMoveReplicaWithCollection_xyz&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1409060 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection testMoveReplicaWithCollection_xyz
   [junit4]   2> 1409061 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/protwords.txt
   [junit4]   2> 1409062 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/managed-schema
   [junit4]   2> 1409063 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/solrconfig.xml
   [junit4]   2> 1409063 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/synonyms.txt
   [junit4]   2> 1409064 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/stopwords.txt
   [junit4]   2> 1409064 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/contractions_it.txt
   [junit4]   2> 1409065 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stemdict_nl.txt
   [junit4]   2> 1409065 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_hy.txt
   [junit4]   2> 1409066 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_no.txt
   [junit4]   2> 1409066 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/contractions_ca.txt
   [junit4]   2> 1409067 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_id.txt
   [junit4]   2> 1409067 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_ga.txt
   [junit4]   2> 1409068 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_hi.txt
   [junit4]   2> 1409068 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_da.txt
   [junit4]   2> 1409069 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_ja.txt
   [junit4]   2> 1409069 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_pt.txt
   [junit4]   2> 1409070 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_hu.txt
   [junit4]   2> 1409071 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_el.txt
   [junit4]   2> 1409071 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_ru.txt
   [junit4]   2> 1409072 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_tr.txt
   [junit4]   2> 1409072 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_ar.txt
   [junit4]   2> 1409073 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/userdict_ja.txt
   [junit4]   2> 1409073 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_eu.txt
   [junit4]   2> 1409074 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_it.txt
   [junit4]   2> 1409075 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_cz.txt
   [junit4]   2> 1409075 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stoptags_ja.txt
   [junit4]   2> 1409076 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/contractions_fr.txt
   [junit4]   2> 1409076 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_de.txt
   [junit4]   2> 1409077 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_fa.txt
   [junit4]   2> 1409078 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/contractions_ga.txt
   [junit4]   2> 1409078 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_ca.txt
   [junit4]   2> 1409079 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_nl.txt
   [junit4]   2> 1409079 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_bg.txt
   [junit4]   2> 1409080 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_lv.txt
   [junit4]   2> 1409080 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_en.txt
   [junit4]   2> 1409081 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_es.txt
   [junit4]   2> 1409081 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_th.txt
   [junit4]   2> 1409082 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_ro.txt
   [junit4]   2> 1409083 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_fr.txt
   [junit4]   2> 1409083 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_sv.txt
   [junit4]   2> 1409084 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_fi.txt
   [junit4]   2> 1409084 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/hyphenations_ga.txt
   [junit4]   2> 1409085 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/lang/stopwords_gl.txt
   [junit4]   2> 1409085 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/params.json
   [junit4]   2> 1409289 DEBUG (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 1409291 INFO  (qtp444998032-24472) [n:127.0.0.1:33911_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMoveReplicaWithCollection_abc.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1409291 INFO  (qtp444998032-24460) [n:127.0.0.1:33911_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1409292 INFO  (qtp1707284511-24469) [n:127.0.0.1:41503_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1409293 DEBUG (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 1409294 INFO  (OverseerThreadFactory-6588-thread-2) [    ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 943546378 sessionWrapper.createTime 943546376651151, this.sessionWrapper.createTime 943546376651151 
   [junit4]   2> 1409296 INFO  (OverseerStateUpdate-72119430086328324-127.0.0.1:33911_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testMoveReplicaWithCollection_xyz",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testMoveReplicaWithCollection_xyz_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33911/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1409498 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr    x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=testMoveReplicaWithCollection_xyz.AUTOCREATED&newCollection=true&name=testMoveReplicaWithCollection_xyz_shard1_replica_n1&action=CREATE&numShards=1&collection=testMoveReplicaWithCollection_xyz&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1410506 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 1410506 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 1410507 WARN  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../contrib/extraction/lib
   [junit4]   2> 1410507 WARN  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../dist
   [junit4]   2> 1410507 WARN  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../contrib/clustering/lib
   [junit4]   2> 1410507 WARN  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../dist
   [junit4]   2> 1410507 WARN  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../contrib/langid/lib
   [junit4]   2> 1410507 WARN  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../dist
   [junit4]   2> 1410507 WARN  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../contrib/velocity/lib
   [junit4]   2> 1410507 WARN  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../dist
   [junit4]   2> 1410507 WARN  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../dist filtered by solr-ltr-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1/../../../../dist
   [junit4]   2> 1410511 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1410523 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.s.IndexSchema [testMoveReplicaWithCollection_xyz_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 1410598 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 1410610 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testMoveReplicaWithCollection_xyz_shard1_replica_n1' using configuration from collection testMoveReplicaWithCollection_xyz, trusted=true
   [junit4]   2> 1410610 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33911.solr.core.testMoveReplicaWithCollection_xyz.shard1.replica_n1' (registry 'solr.core.testMoveReplicaWithCollection_xyz.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@603c9810
   [junit4]   2> 1410611 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1410611 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.SolrCore [[testMoveReplicaWithCollection_xyz_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/testMoveReplicaWithCollection_xyz_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001/tempDir-001/node1/./testMoveReplicaWithCollection_xyz_shard1_replica_n1/data/]
   [junit4]   2> 1410613 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 1410645 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1410645 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1410679 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 1410679 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1410680 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b578073[testMoveReplicaWithCollection_xyz_shard1_replica_n1] main]
   [junit4]   2> 1410681 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED
   [junit4]   2> 1410681 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/testMoveReplicaWithCollection_xyz.AUTOCREATED
   [junit4]   2> 1410681 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/testMoveReplicaWithCollection_xyz.AUTOCREATED/managed-schema
   [junit4]   2> 1410681 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1410682 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 1410682 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 1410683 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1410683 INFO  (qtp444998032-24537) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1608139420885581824
   [junit4]   2> 1410683 INFO  (searcherExecutor-6605-thread-1-processing-n:127.0.0.1:33911_solr x:testMoveReplicaWithCollection_xyz_shard1_replica_n1 c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2) [n:127.0.0.1:33911_solr c:testMoveReplicaWithCollection_xyz s:shard1 r:core_node2 x:testMoveReplicaWithCollection_xyz_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@5b578073[testMoveReplicaWithCollection_xyz_s

[...truncated too long message...]

solr c:testMoveReplicaMainCollection_xyz s:shard1 r:core_node4 x:testMoveReplicaMainCollection_xyz_shard1_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testMoveReplicaMainCollection_xyz.shard1.leader, tag=7e733388
   [junit4]   2> 199136 INFO  (jetty-closer-127-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2598751c{/solr,null,UNAVAILABLE}
   [junit4]   2> 199136 INFO  (jetty-closer-127-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 199136 ERROR (SUITE-TestWithCollection-seed#[EF87C5A37A165324]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 199137 INFO  (SUITE-TestWithCollection-seed#[EF87C5A37A165324]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46757 46757
   [junit4]   2> 199242 INFO  (Thread-63) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46757 46757
   [junit4]   2> 199243 WARN  (Thread-63) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	25	/solr/collections/testNodeAdded_xyz/terms/shard1
   [junit4]   2> 	25	/solr/collections/testNodeAdded_abc/terms/shard1
   [junit4]   2> 	20	/solr/aliases.json
   [junit4]   2> 	12	/solr/collections/testMultipleWithCollections_abc/terms/shard1
   [junit4]   2> 	12	/solr/collections/testAddReplica_abc/terms/shard1
   [junit4]   2> 	12	/solr/collections/testDeleteWithCollection_abc/terms/shard1
   [junit4]   2> 	12	/solr/collections/testMultipleWithCollections_xyz/terms/shard1
   [junit4]   2> 	11	/solr/collections/testMultipleWithCollections_abc2/terms/shard1
   [junit4]   2> 	11	/solr/collections/testAddReplicaWithPolicy_abc/terms/shard1
   [junit4]   2> 	11	/solr/collections/testMoveReplicaMainCollection_xyz/terms/shard1
   [junit4]   2> 	10	/solr/collections/testMultipleWithCollections_xyz2/terms/shard1
   [junit4]   2> 	10	/solr/collections/testAddReplica_xyz/terms/shard1
   [junit4]   2> 	10	/solr/collections/testAddReplicaWithPolicy_xyz/terms/shard1
   [junit4]   2> 	9	/solr/collections/testMoveReplicaMainCollection_abc/terms/shard1
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	3	/solr/configs/testNodeAdded_xyz.AUTOCREATED
   [junit4]   2> 	3	/solr/collections/testCreateCollection_abc/terms/shard1
   [junit4]   2> 	3	/solr/configs/testNodeAdded_abc.AUTOCREATED/managed-schema
   [junit4]   2> 	3	/solr/collections/testCreateCollectionNoWithCollection_abc/terms/shard2
   [junit4]   2> 	3	/solr/collections/testMoveReplicaWithCollection_abc/terms/shard1
   [junit4]   2> 	3	/solr/collections/testCreateCollectionNoWithCollection_abc/terms/shard1
   [junit4]   2> 	3	/solr/configs/testNodeAdded_xyz.AUTOCREATED/managed-schema
   [junit4]   2> 	3	/solr/collections/testCreateCollection_xyz/terms/shard1
   [junit4]   2> 	3	/solr/configs/testNodeAdded_abc.AUTOCREATED
   [junit4]   2> 	3	/solr/collections/testMoveReplicaWithCollection_xyz/terms/shard1
   [junit4]   2> 	2	/solr/configs/testAddReplicaWithPolicy_xyz.AUTOCREATED
   [junit4]   2> 	2	/solr/collections/testNodeAdded_xyz/state.json
   [junit4]   2> 	2	/solr/configs/testAddReplica_abc.AUTOCREATED
   [junit4]   2> 	2	/solr/configs/testCreateCollectionNoWithCollection_abc.AUTOCREATED
   [junit4]   2> 	2	/solr/configs/testMultipleWithCollections_xyz2.AUTOCREATED
   [junit4]   2> 	2	/solr/configs/testMoveReplicaMainCollection_xyz.AUTOCREATED
   [junit4]   2> 	2	/solr/configs/testAddReplica_abc.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/configs/testMultipleWithCollections_abc2.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/configs/testAddReplicaWithPolicy_abc.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/configs/testAddReplicaWithPolicy_abc.AUTOCREATED
   [junit4]   2> 	2	/solr/collections/testNodeAdded_abc/state.json
   [junit4]   2> 	2	/solr/configs/testMultipleWithCollections_abc.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/configs/testMultipleWithCollections_abc2.AUTOCREATED
   [junit4]   2> 	2	/solr/configs/testMultipleWithCollections_xyz.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/configs/testMoveReplicaMainCollection_abc.AUTOCREATED
   [junit4]   2> 	2	/solr/configs/testDeleteWithCollection_abc.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/configs/testAddReplica_xyz.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/configs/testAddReplicaWithPolicy_xyz.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/configs/testAddReplica_xyz.AUTOCREATED
   [junit4]   2> 	2	/solr/collections/testDeleteWithCollection_xyz/terms/shard1
   [junit4]   2> 	2	/solr/configs/testDeleteWithCollection_abc.AUTOCREATED
   [junit4]   2> 	2	/solr/configs/testCreateCollectionNoWithCollection_abc.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/configs/testMoveReplicaMainCollection_abc.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/configs/testMultipleWithCollections_abc.AUTOCREATED
   [junit4]   2> 	2	/solr/configs/testMultipleWithCollections_xyz2.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/configs/testMultipleWithCollections_xyz.AUTOCREATED
   [junit4]   2> 	2	/solr/configs/testMoveReplicaMainCollection_xyz.AUTOCREATED/managed-schema
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	45	/solr/aliases.json
   [junit4]   2> 	20	/solr/clusterprops.json
   [junit4]   2> 	20	/solr/clusterstate.json
   [junit4]   2> 	13	/solr/collections/testNodeAdded_xyz/state.json
   [junit4]   2> 	13	/solr/collections/testNodeAdded_abc/state.json
   [junit4]   2> 	6	/solr/collections/testMultipleWithCollections_abc/state.json
   [junit4]   2> 	6	/solr/collections/testMoveReplicaMainCollection_xyz/state.json
   [junit4]   2> 	5	/solr/collections/testMoveReplicaMainCollection_abc/state.json
   [junit4]   2> 	5	/solr/collections/testAddReplica_abc/state.json
   [junit4]   2> 	5	/solr/collections/testAddReplicaWithPolicy_abc/state.json
   [junit4]   2> 	5	/solr/collections/testMultipleWithCollections_abc2/state.json
   [junit4]   2> 	5	/solr/collections/testDeleteWithCollection_abc/state.json
   [junit4]   2> 	5	/solr/collections/testMultipleWithCollections_xyz/state.json
   [junit4]   2> 	4	/solr/collections/testMultipleWithCollections_xyz2/state.json
   [junit4]   2> 	4	/solr/collections/testAddReplica_xyz/state.json
   [junit4]   2> 	3	/solr/collections/testAddReplicaWithPolicy_xyz/state.json
   [junit4]   2> 	2	/solr/collections/testNodeAdded_xyz/leader_elect/shard1/election/72119516263284742-core_node2-n_0000000000
   [junit4]   2> 	2	/solr/collections/testCreateCollectionNoWithCollection_abc/state.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72119516263284740-127.0.0.1:35493_solr-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	194	/solr/collections
   [junit4]   2> 	51	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestWithCollection_EF87C5A37A165324-001
   [junit4]   2> Aug 07, 2018 11:50:58 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1389, maxMBSortInHeap=7.143685513444962, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@6bf255b0), locale=ka, timezone=America/Mazatlan
   [junit4]   2> NOTE: Linux 4.15.0-29-generic amd64/Oracle Corporation 10.0.1 (64-bit)/cpus=8,threads=1,free=353907064,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestWithCollection, TestWithCollection]
   [junit4] Completed [4/5 (1!)] on J0 in 85.02s, 9 tests, 1 error <<< FAILURES!

[...truncated 23 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1568: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 5 suites, 45 tests, 1 error [seed: EF87C5A37A165324]

Total time: 3 minutes 36 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   1/5 failed: org.apache.solr.cloud.TestWithCollection
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=08ca54f1f89eb98f6a3238f0f91c1f8383c12119, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #22619
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-11-ea+25) - Build # 22619 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/22619/
Java: 64bit/jdk-11-ea+25 -XX:+UseCompressedOops -XX:+UseParallelGC

11 tests failed.
FAILED:  org.apache.solr.cloud.TestSkipOverseerOperations.testSkipDownOperations

Error Message:
Expected 2x2 for collection: collection2 null Live Nodes: [127.0.0.1:33091_solr, 127.0.0.1:37423_solr, 127.0.0.1:42947_solr] Last available state: null

Stack Trace:
java.lang.AssertionError: Expected 2x2 for collection: collection2
null
Live Nodes: [127.0.0.1:33091_solr, 127.0.0.1:37423_solr, 127.0.0.1:42947_solr]
Last available state: null
	at __randomizedtesting.SeedInfo.seed([DFB84CB763494660:182A3EF19E05FDB6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:278)
	at org.apache.solr.cloud.TestSkipOverseerOperations.testSkipDownOperations(TestSkipOverseerOperations.java:104)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestSkipOverseerOperations.testSkipDownOperations

Error Message:
expected:<14> but was:<15>

Stack Trace:
java.lang.AssertionError: expected:<14> but was:<15>
	at __randomizedtesting.SeedInfo.seed([DFB84CB763494660:182A3EF19E05FDB6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.TestSkipOverseerOperations.testSkipDownOperations(TestSkipOverseerOperations.java:108)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestSkipOverseerOperations.testSkipLeaderOperations

Error Message:
expected:<14> but was:<16>

Stack Trace:
java.lang.AssertionError: expected:<14> but was:<16>
	at __randomizedtesting.SeedInfo.seed([DFB84CB763494660:2F529F4BBC6A360A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.TestSkipOverseerOperations.testSkipLeaderOperations(TestSkipOverseerOperations.java:72)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestSkipOverseerOperations.testSkipDownOperations

Error Message:
Expected 2x2 for collection: collection2 null Live Nodes: [127.0.0.1:33863_solr, 127.0.0.1:36127_solr, 127.0.0.1:38601_solr] Last available state: null

Stack Trace:
java.lang.AssertionError: Expected 2x2 for collection: collection2
null
Live Nodes: [127.0.0.1:33863_solr, 127.0.0.1:36127_solr, 127.0.0.1:38601_solr]
Last available state: null
	at __randomizedtesting.SeedInfo.seed([DFB84CB763494660:182A3EF19E05FDB6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:278)
	at org.apache.solr.cloud.TestSkipOverseerOperations.testSkipDownOperations(TestSkipOverseerOperations.java:104)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestSkipOverseerOperations.testSkipDownOperations

Error Message:
Expected 2x2 for collection: collection2 null Live Nodes: [127.0.0.1:33119_solr, 127.0.0.1:33211_solr, 127.0.0.1:40061_solr] Last available state: null

Stack Trace:
java.lang.AssertionError: Expected 2x2 for collection: collection2
null
Live Nodes: [127.0.0.1:33119_solr, 127.0.0.1:33211_solr, 127.0.0.1:40061_solr]
Last available state: null
	at __randomizedtesting.SeedInfo.seed([DFB84CB763494660:182A3EF19E05FDB6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:278)
	at org.apache.solr.cloud.TestSkipOverseerOperations.testSkipDownOperations(TestSkipOverseerOperations.java:104)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir

Error Message:
cluster 2 docs mismatch expected:<1000> but was:<0>

Stack Trace:
java.lang.AssertionError: cluster 2 docs mismatch expected:<1000> but was:<0>
	at __randomizedtesting.SeedInfo.seed([DFB84CB763494660:9A63BC557B670A22]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir(CdcrBidirectionalTest.java:100)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir

Error Message:
Collection not found: cdcr-cluster1

Stack Trace:
org.apache.solr.common.SolrException: Collection not found: cdcr-cluster1
	at __randomizedtesting.SeedInfo.seed([DFB84CB763494660:9A63BC557B670A22]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:853)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
	at org.apache.solr.cloud.cdcr.CdcrTestsUtil.invokeCdcrAction(CdcrTestsUtil.java:70)
	at org.apache.solr.cloud.cdcr.CdcrTestsUtil.cdcrStart(CdcrTestsUtil.java:47)
	at org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir(CdcrBidirectionalTest.java:78)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir

Error Message:
Collection not found: cdcr-cluster1

Stack Trace:
org.apache.solr.common.SolrException: Collection not found: cdcr-cluster1
	at __randomizedtesting.SeedInfo.seed([DFB84CB763494660:9A63BC557B670A22]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:853)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
	at org.apache.solr.cloud.cdcr.CdcrTestsUtil.invokeCdcrAction(CdcrTestsUtil.java:70)
	at org.apache.solr.cloud.cdcr.CdcrTestsUtil.cdcrStart(CdcrTestsUtil.java:47)
	at org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir(CdcrBidirectionalTest.java:78)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir

Error Message:
Collection not found: cdcr-cluster2

Stack Trace:
org.apache.solr.common.SolrException: Collection not found: cdcr-cluster2
	at __randomizedtesting.SeedInfo.seed([DFB84CB763494660:9A63BC557B670A22]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:853)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:484)
	at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:463)
	at org.apache.solr.cloud.cdcr.CdcrTestsUtil.waitForClusterToSync(CdcrTestsUtil.java:108)
	at org.apache.solr.cloud.cdcr.CdcrTestsUtil.waitForClusterToSync(CdcrTestsUtil.java:101)
	at org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir(CdcrBidirectionalTest.java:100)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir

Error Message:
Collection not found: cdcr-cluster1

Stack Trace:
org.apache.solr.common.SolrException: Collection not found: cdcr-cluster1
	at __randomizedtesting.SeedInfo.seed([DFB84CB763494660:9A63BC557B670A22]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:853)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
	at org.apache.solr.cloud.cdcr.CdcrTestsUtil.invokeCdcrAction(CdcrTestsUtil.java:70)
	at org.apache.solr.cloud.cdcr.CdcrTestsUtil.cdcrStart(CdcrTestsUtil.java:47)
	at org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir(CdcrBidirectionalTest.java:78)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir

Error Message:
Collection not found: cdcr-cluster1

Stack Trace:
org.apache.solr.common.SolrException: Collection not found: cdcr-cluster1
	at __randomizedtesting.SeedInfo.seed([DFB84CB763494660:9A63BC557B670A22]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:853)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
	at org.apache.solr.cloud.cdcr.CdcrTestsUtil.invokeCdcrAction(CdcrTestsUtil.java:70)
	at org.apache.solr.cloud.cdcr.CdcrTestsUtil.cdcrStart(CdcrTestsUtil.java:47)
	at org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir(CdcrBidirectionalTest.java:78)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)




Build Log:
[...truncated 13586 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestSkipOverseerOperations
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSkipOverseerOperations_DFB84CB763494660-001/init-core-data-001
   [junit4]   2> 714041 WARN  (SUITE-TestSkipOverseerOperations-seed#[DFB84CB763494660]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=30 numCloses=30
   [junit4]   2> 714041 INFO  (SUITE-TestSkipOverseerOperations-seed#[DFB84CB763494660]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 714042 INFO  (SUITE-TestSkipOverseerOperations-seed#[DFB84CB763494660]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 714042 INFO  (SUITE-TestSkipOverseerOperations-seed#[DFB84CB763494660]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 714042 INFO  (SUITE-TestSkipOverseerOperations-seed#[DFB84CB763494660]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSkipOverseerOperations_DFB84CB763494660-001/tempDir-001
   [junit4]   2> 714042 INFO  (SUITE-TestSkipOverseerOperations-seed#[DFB84CB763494660]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 714043 INFO  (Thread-3185) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 714043 INFO  (Thread-3185) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 714044 ERROR (Thread-3185) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 714143 INFO  (SUITE-TestSkipOverseerOperations-seed#[DFB84CB763494660]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:35265
   [junit4]   2> 714144 INFO  (zkConnectionManagerCallback-5959-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714147 INFO  (jetty-launcher-5956-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 11-ea+25
   [junit4]   2> 714147 INFO  (jetty-launcher-5956-thread-3) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 11-ea+25
   [junit4]   2> 714152 INFO  (jetty-launcher-5956-thread-2) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 11-ea+25
   [junit4]   2> 714173 INFO  (jetty-launcher-5956-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 714173 INFO  (jetty-launcher-5956-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 714173 INFO  (jetty-launcher-5956-thread-2) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 714173 INFO  (jetty-launcher-5956-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 714173 INFO  (jetty-launcher-5956-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 714173 INFO  (jetty-launcher-5956-thread-3) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 714173 INFO  (jetty-launcher-5956-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 714173 INFO  (jetty-launcher-5956-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 714173 INFO  (jetty-launcher-5956-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 714173 INFO  (jetty-launcher-5956-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35177899{/solr,null,AVAILABLE}
   [junit4]   2> 714173 INFO  (jetty-launcher-5956-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2c109dfb{/solr,null,AVAILABLE}
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@720d2194{/solr,null,AVAILABLE}
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@39458678{SSL,[ssl, http/1.1]}{127.0.0.1:33211}
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@68b195f1{SSL,[ssl, http/1.1]}{127.0.0.1:40061}
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-2) [    ] o.e.j.s.Server Started @714196ms
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-3) [    ] o.e.j.s.Server Started @714196ms
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40061}
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33211}
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3cddbc17{SSL,[ssl, http/1.1]}{127.0.0.1:33119}
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-1) [    ] o.e.j.s.Server Started @714197ms
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33119}
   [junit4]   2> 714174 ERROR (jetty-launcher-5956-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 714174 ERROR (jetty-launcher-5956-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 714174 ERROR (jetty-launcher-5956-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-08-07T07:59:41.095790Z
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-08-07T07:59:41.095801Z
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 714174 INFO  (jetty-launcher-5956-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-08-07T07:59:41.095901Z
   [junit4]   2> 714182 INFO  (zkConnectionManagerCallback-5963-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714182 INFO  (zkConnectionManagerCallback-5965-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714183 INFO  (zkConnectionManagerCallback-5961-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714183 INFO  (jetty-launcher-5956-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 714183 INFO  (jetty-launcher-5956-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 714183 INFO  (jetty-launcher-5956-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 714187 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100377eefe80002, likely client has closed socket
   [junit4]   2> 714340 INFO  (jetty-launcher-5956-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35265/solr
   [junit4]   2> 714343 INFO  (zkConnectionManagerCallback-5969-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714351 INFO  (zkConnectionManagerCallback-5971-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714412 INFO  (jetty-launcher-5956-thread-3) [n:127.0.0.1:40061_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40061_solr
   [junit4]   2> 714412 INFO  (jetty-launcher-5956-thread-3) [n:127.0.0.1:40061_solr    ] o.a.s.c.Overseer Overseer (id=72118612368293893-127.0.0.1:40061_solr-n_0000000000) starting
   [junit4]   2> 714420 INFO  (zkConnectionManagerCallback-5980-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714420 INFO  (jetty-launcher-5956-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35265/solr
   [junit4]   2> 714421 INFO  (jetty-launcher-5956-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35265/solr
   [junit4]   2> 714422 INFO  (jetty-launcher-5956-thread-3) [n:127.0.0.1:40061_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35265/solr ready
   [junit4]   2> 714431 INFO  (zkConnectionManagerCallback-5984-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714431 INFO  (OverseerStateUpdate-72118612368293893-127.0.0.1:40061_solr-n_0000000000) [    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:40061_solr
   [junit4]   2> 714443 INFO  (jetty-launcher-5956-thread-3) [n:127.0.0.1:40061_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40061_solr
   [junit4]   2> 714445 INFO  (zkConnectionManagerCallback-5988-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714450 INFO  (jetty-launcher-5956-thread-2) [n:127.0.0.1:33211_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 714452 INFO  (zkConnectionManagerCallback-5986-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714455 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100377eefe80008, likely client has closed socket
   [junit4]   2> 714458 INFO  (zkCallback-5979-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 714458 INFO  (jetty-launcher-5956-thread-2) [n:127.0.0.1:33211_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 714458 INFO  (jetty-launcher-5956-thread-2) [n:127.0.0.1:33211_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33211_solr
   [junit4]   2> 714459 INFO  (zkCallback-5970-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 714463 INFO  (zkCallback-5979-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 714466 INFO  (zkCallback-5987-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 714471 INFO  (zkConnectionManagerCallback-5993-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714474 INFO  (jetty-launcher-5956-thread-1) [n:127.0.0.1:33119_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 714476 INFO  (jetty-launcher-5956-thread-1) [n:127.0.0.1:33119_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 714476 INFO  (jetty-launcher-5956-thread-1) [n:127.0.0.1:33119_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33119_solr
   [junit4]   2> 714476 INFO  (zkCallback-5970-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 714476 INFO  (zkCallback-5987-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 714476 INFO  (zkCallback-5979-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 714483 INFO  (jetty-launcher-5956-thread-3) [n:127.0.0.1:40061_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 714487 INFO  (zkCallback-5992-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 714491 INFO  (zkConnectionManagerCallback-6000-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714492 INFO  (jetty-launcher-5956-thread-2) [n:127.0.0.1:33211_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 714492 INFO  (jetty-launcher-5956-thread-2) [n:127.0.0.1:33211_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35265/solr ready
   [junit4]   2> 714493 INFO  (jetty-launcher-5956-thread-3) [n:127.0.0.1:40061_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40061.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13718e63
   [junit4]   2> 714495 INFO  (zkConnectionManagerCallback-6005-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714496 INFO  (jetty-launcher-5956-thread-1) [n:127.0.0.1:33119_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 714496 INFO  (jetty-launcher-5956-thread-1) [n:127.0.0.1:33119_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35265/solr ready
   [junit4]   2> 714498 INFO  (jetty-launcher-5956-thread-3) [n:127.0.0.1:40061_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40061.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13718e63
   [junit4]   2> 714498 INFO  (jetty-launcher-5956-thread-3) [n:127.0.0.1:40061_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40061.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13718e63
   [junit4]   2> 714499 INFO  (jetty-launcher-5956-thread-3) [n:127.0.0.1:40061_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSkipOverseerOperations_DFB84CB763494660-001/tempDir-001/node3/.
   [junit4]   2> 714499 INFO  (jetty-launcher-5956-thread-2) [n:127.0.0.1:33211_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 714499 INFO  (jetty-launcher-5956-thread-1) [n:127.0.0.1:33119_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 714512 INFO  (jetty-launcher-5956-thread-2) [n:127.0.0.1:33211_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33211.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13718e63
   [junit4]   2> 714512 INFO  (jetty-launcher-5956-thread-1) [n:127.0.0.1:33119_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33119.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13718e63
   [junit4]   2> 714520 INFO  (jetty-launcher-5956-thread-2) [n:127.0.0.1:33211_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33211.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13718e63
   [junit4]   2> 714520 INFO  (jetty-launcher-5956-thread-1) [n:127.0.0.1:33119_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33119.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13718e63
   [junit4]   2> 714521 INFO  (jetty-launcher-5956-thread-1) [n:127.0.0.1:33119_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33119.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13718e63
   [junit4]   2> 714521 INFO  (jetty-launcher-5956-thread-2) [n:127.0.0.1:33211_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33211.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@13718e63
   [junit4]   2> 714522 INFO  (jetty-launcher-5956-thread-2) [n:127.0.0.1:33211_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSkipOverseerOperations_DFB84CB763494660-001/tempDir-001/node2/.
   [junit4]   2> 714522 INFO  (jetty-launcher-5956-thread-1) [n:127.0.0.1:33119_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSkipOverseerOperations_DFB84CB763494660-001/tempDir-001/node1/.
   [junit4]   2> 714552 INFO  (zkConnectionManagerCallback-6009-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714553 INFO  (zkConnectionManagerCallback-6014-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714554 INFO  (SUITE-TestSkipOverseerOperations-seed#[DFB84CB763494660]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 714555 INFO  (SUITE-TestSkipOverseerOperations-seed#[DFB84CB763494660]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35265/solr ready
   [junit4]   2> 714566 INFO  (TEST-TestSkipOverseerOperations.testSkipDownOperations-seed#[DFB84CB763494660]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSkipDownOperations
   [junit4]   2> 714576 INFO  (qtp2054111051-16348) [n:127.0.0.1:33211_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 714580 INFO  (qtp2054111051-16348) [n:127.0.0.1:33211_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=4
   [junit4]   2> 714582 INFO  (qtp2054111051-16346) [n:127.0.0.1:33211_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&maxShardsPerNode=2&name=collection2&nrtReplicas=2&action=CREATE&numShards=2&tlogReplicas=0&createNodeSet=127.0.0.1:33211_solr,127.0.0.1:33119_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 714584 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection2
   [junit4]   2> 714584 INFO  (OverseerCollectionConfigSetProcessor-72118612368293893-127.0.0.1:40061_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 714584 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/collection2.AUTOCREATED/protwords.txt
   [junit4]   2> 714585 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/collection2.AUTOCREATED/managed-schema
   [junit4]   2> 714585 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/collection2.AUTOCREATED/solrconfig.xml
   [junit4]   2> 714587 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/collection2.AUTOCREATED/synonyms.txt
   [junit4]   2> 714587 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/collection2.AUTOCREATED/stopwords.txt
   [junit4]   2> 714588 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/collection2.AUTOCREATED/lang/contractions_it.txt
   [junit4]   2> 714589 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/collection2.AUTOCREATED/lang/stemdict_nl.txt
   [junit4]   2> 714589 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/collection2.AUTOCREATED/lang/stopwords_hy.txt
   [junit4]   2> 714590 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/collection2.AUTOCREATED/lang/stopwords_no.txt
   [junit4]   2> 714591 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/collection2.AUTOCREATED/lang/contractions_ca.txt
   [junit4]   2> 714591 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/collection2.AUTOCREATED/lang/stopwords_id.txt
   [junit4]   2> 714592 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/collection2.AUTOCREATED/lang/stopwords_ga.txt
   [junit4]   2> 714593 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/collection2.AUTOCREATED/lang/stopwords_hi.txt
   [junit4]   2> 714593 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/collection2.AUTOCREATED/lang/stopwords_da.txt
   [junit4]   2> 714594 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/collection2.AUTOCREATED/lang/stopwords_ja.txt
   [junit4]   2> 714595 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/collection2.AUTOCREATED/lang/stopwords_pt.txt
   [junit4]   2> 714595 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/collection2.AUTOCREATED/lang/stopwords_hu.txt
   [junit4]   2> 714596 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/collection2.AUTOCREATED/lang/stopwords_el.txt
   [junit4]   2> 714597 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/collection2.AUTOCREATED/lang/stopwords_ru.txt
   [junit4]   2> 714597 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/collection2.AUTOCREATED/lang/stopwords_tr.txt
   [junit4]   2> 714598 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/collection2.AUTOCREATED/lang/stopwords_ar.txt
   [junit4]   2> 714599 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/collection2.AUTOCREATED/lang/userdict_ja.txt
   [junit4]   2> 714599 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/collection2.AUTOCREATED/lang/stopwords_eu.txt
   [junit4]   2> 714599 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/collection2.AUTOCREATED/lang/stopwords_it.txt
   [junit4]   2> 714600 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/collection2.AUTOCREATED/lang/stopwords_cz.txt
   [junit4]   2> 714601 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/collection2.AUTOCREATED/lang/stoptags_ja.txt
   [junit4]   2> 714601 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/collection2.AUTOCREATED/lang/contractions_fr.txt
   [junit4]   2> 714602 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/collection2.AUTOCREATED/lang/stopwords_de.txt
   [junit4]   2> 714606 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/collection2.AUTOCREATED/lang/stopwords_fa.txt
   [junit4]   2> 714607 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/collection2.AUTOCREATED/lang/contractions_ga.txt
   [junit4]   2> 714607 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/collection2.AUTOCREATED/lang/stopwords_ca.txt
   [junit4]   2> 714608 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/collection2.AUTOCREATED/lang/stopwords_nl.txt
   [junit4]   2> 714608 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/collection2.AUTOCREATED/lang/stopwords_bg.txt
   [junit4]   2> 714608 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/collection2.AUTOCREATED/lang/stopwords_lv.txt
   [junit4]   2> 714609 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/collection2.AUTOCREATED/lang/stopwords_en.txt
   [junit4]   2> 714609 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/collection2.AUTOCREATED/lang/stopwords_es.txt
   [junit4]   2> 714610 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/collection2.AUTOCREATED/lang/stopwords_th.txt
   [junit4]   2> 714610 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/collection2.AUTOCREATED/lang/stopwords_ro.txt
   [junit4]   2> 714611 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/collection2.AUTOCREATED/lang/stopwords_fr.txt
   [junit4]   2> 714611 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/collection2.AUTOCREATED/lang/stopwords_sv.txt
   [junit4]   2> 714612 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/collection2.AUTOCREATED/lang/stopwords_fi.txt
   [junit4]   2> 714613 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/collection2.AUTOCREATED/lang/hyphenations_ga.txt
   [junit4]   2> 714613 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/collection2.AUTOCREATED/lang/stopwords_gl.txt
   [junit4]   2> 714614 INFO  (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/collection2.AUTOCREATED/params.json
   [junit4]   2> 714717 INFO  (OverseerStateUpdate-72118612368293893-127.0.0.1:40061_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"collection2_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33211/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 714719 INFO  (OverseerStateUpdate-72118612368293893-127.0.0.1:40061_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"collection2_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33119/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 714719 INFO  (OverseerStateUpdate-72118612368293893-127.0.0.1:40061_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"collection2_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33211/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 714720 INFO  (OverseerStateUpdate-72118612368293893-127.0.0.1:40061_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"collection2_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33119/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 714933 INFO  (qtp2054111051-16449) [n:127.0.0.1:33211_solr    x:collection2_shard2_replica_n4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=collection2.AUTOCREATED&newCollection=true&name=collection2_shard2_replica_n4&action=CREATE&numShards=2&collection=collection2&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 714928 ERROR (OverseerThreadFactory-4298-thread-2) [    ] o.a.s.c.a.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:33211/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:33211/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172) ~[java/:?]
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6]
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) [java/:?]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:834) [?:?]
   [junit4]   2> Caused by: javax.net.ssl.SSLException: Received fatal alert: internal_error
   [junit4]   2> 	at sun.security.ssl.Alert.createSSLException(Alert.java:129) ~[?:?]
   [junit4]   2> 	at sun.security.ssl.Alert.createSSLException(Alert.java:117) ~[?:?]
   [junit4]   2> 	at sun.security.ssl.TransportContext.fatal(TransportContext.java:312) ~[?:?]
   [junit4]   2> 	at sun.security.ssl.Alert$AlertConsumer.consume(Alert.java:270) ~[?:?]
   [junit4]   2> 	at sun.security.ssl.TransportContext.dispatch(TransportContext.java:181) ~[?:?]
   [junit4]   2> 	at sun.security.ssl.SSLTransport.decode(SSLTransport.java:164) ~[?:?]
   [junit4]   2> 	at sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:877) ~[?:?]
   [junit4]   2> 	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:810) ~[?:?]
   [junit4]   2> 	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:383) ~[?:?]
   [junit4]   2> 	at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56) ~[httpclient-4.5.3.jar:4.5.3]
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542) ~[java/:?]
   [junit4]   2> 	... 12 more
   [junit4]   2> 714940 INFO  (qtp972552496-16338) [n:127.0.0.1:33119_solr    x:collection2_shard2_replica_n6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=collection2.AUTOCREATED&newCollection=true&name=collection2_shard2_replica_n6&action=CREATE&numShards=2&collection=collection2&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 714940 INFO  (qtp972552496-16354) [n:127.0.0.1:33119_solr    x:collection2_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=collection2.AUTOCREATED&newCollection=true&name=collection2_shard1_replica_n2&action=CREATE&numShards=2&collection=collection2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 715941 INFO  (qtp2054111051-16449) [n:127.0.0.1:33211_solr c:collection2 s:shard2 r:core_node7 x:collection2_shard2_replica_n4] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 715941 INFO  (qtp2054111051-16449) [n:127.0.0.1:33211_solr c:collection2 s:shard2 r:core_node7 x:collection2_shard2_replica_n4] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 715942 WARN  (qtp2054111051-16449) [n:127.0.0.1:33211_solr c:collection2 s:shard2 r:core_node7 x:collection2_shard2_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSkipOverseerOperations_DFB84CB763494660-001/tempDir-001/node2/collection2_shard2_replica_n4/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSkipOverseerOperations_DFB84CB763494660-001/tempDir-001/node2/collection2_shard2_replica_n4/../../../../contrib/extraction/lib
   [junit4]   2> 715942 WARN  (qtp2054111051-16449) [n:127.0.0.1:33211_solr c:collection2 s:shard2 r:core_node7 x:collection2_shard2_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSkipOverseerOperations_DFB84CB763494660-001/tempDir-001/node2/collection2_shard2_replica_n4/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSkipOverseerOperations_DFB84CB763494660-001/tempDir-001/node2/collection2_shard2_replica_n4/../../../../dist
   [junit4]   2> 715942 WARN  (qtp2054111051-16449) [n:127.0.0.1:33211_solr c:coll

[...truncated too long message...]

oller Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33863_solr
   [junit4]   2> 249732 INFO  (jetty-closer-316-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 249732 INFO  (zkCallback-352-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 249732 INFO  (zkCallback-428-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 249732 INFO  (zkCallback-412-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 249732 INFO  (zkCallback-435-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 249733 INFO  (zkCallback-419-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 249733 INFO  (zkCallback-337-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 249735 INFO  (jetty-closer-316-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 249735 INFO  (jetty-closer-316-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7c72e92a: rootName = solr_38601, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6c5f6354
   [junit4]   2> 249737 INFO  (jetty-closer-316-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6dc7bbdf{/solr,null,UNAVAILABLE}
   [junit4]   2> 249738 INFO  (jetty-closer-316-thread-3) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38601_solr
   [junit4]   2> 249738 INFO  (jetty-closer-316-thread-2) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 249738 INFO  (jetty-closer-316-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 249738 INFO  (zkCallback-337-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 249738 INFO  (zkCallback-352-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 249738 INFO  (jetty-closer-316-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 249738 INFO  (zkCallback-428-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 249739 INFO  (zkCallback-435-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 249739 INFO  (jetty-closer-316-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4af3eac4: rootName = solr_36127, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6c5f6354
   [junit4]   2> 249741 INFO  (jetty-closer-316-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@22fbe953{/solr,null,UNAVAILABLE}
   [junit4]   2> 249742 INFO  (jetty-closer-316-thread-3) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 249742 INFO  (jetty-closer-316-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36127_solr
   [junit4]   2> 249742 INFO  (jetty-closer-316-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 249742 INFO  (zkCallback-352-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 249745 INFO  (zkCallback-337-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 249746 INFO  (jetty-closer-316-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72118748209283079-127.0.0.1:36127_solr-n_0000000000) closing
   [junit4]   2> 249746 INFO  (OverseerStateUpdate-72118748209283079-127.0.0.1:36127_solr-n_0000000000) [    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:36127_solr
   [junit4]   2> 249746 WARN  (OverseerAutoScalingTriggerThread-72118748209283079-127.0.0.1:36127_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 249749 INFO  (jetty-closer-316-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@79747c68{/solr,null,UNAVAILABLE}
   [junit4]   2> 249749 INFO  (jetty-closer-316-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 249750 ERROR (SUITE-TestSkipOverseerOperations-seed#[DFB84CB763494660]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 249750 INFO  (SUITE-TestSkipOverseerOperations-seed#[DFB84CB763494660]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38911 38911
   [junit4]   2> 249856 INFO  (Thread-177) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38911 38911
   [junit4]   2> 249857 WARN  (Thread-177) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	15	/solr/aliases.json
   [junit4]   2> 	8	/solr/collections/collection2/terms/shard1
   [junit4]   2> 	7	/solr/security.json
   [junit4]   2> 	4	/solr/configs/collection1.AUTOCREATED/managed-schema
   [junit4]   2> 	4	/solr/configs/collection1.AUTOCREATED
   [junit4]   2> 	4	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	4	/solr/collections/collection1/terms/shard2
   [junit4]   2> 	3	/solr/collections/collection1/state.json
   [junit4]   2> 	3	/solr/configs/collection2.AUTOCREATED/managed-schema
   [junit4]   2> 	3	/solr/collections/collection2/terms/shard2
   [junit4]   2> 	2	/solr/configs/collection2.AUTOCREATED
   [junit4]   2> 	2	/solr/collections/collection2/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	17	/solr/collections/collection1/state.json
   [junit4]   2> 	15	/solr/clusterstate.json
   [junit4]   2> 	15	/solr/clusterprops.json
   [junit4]   2> 	6	/solr/overseer_elect/election/72118748209283079-127.0.0.1:36127_solr-n_0000000000
   [junit4]   2> 	4	/solr/collections/collection2/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	15	/solr/live_nodes
   [junit4]   2> 	15	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSkipOverseerOperations_DFB84CB763494660-001
   [junit4]   2> Aug 07, 2018 8:36:32 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=2, maxDocsPerChunk=8, blockSize=937), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=2, blockSize=937)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4700d37e), locale=fr-YT, timezone=America/Jamaica
   [junit4]   2> NOTE: Linux 4.15.0-29-generic amd64/Oracle Corporation 11-ea (64-bit)/cpus=8,threads=1,free=298103656,total=526385152
   [junit4]   2> NOTE: All tests run in this JVM: [TestSkipOverseerOperations, CdcrBidirectionalTest, TestSkipOverseerOperations, TestSkipOverseerOperations]
   [junit4] Completed [10/10 (8!)] on J1 in 138.65s, 2 tests, 1 failure <<< FAILURES!

[...truncated 19 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1568: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 10 suites, 15 tests, 4 errors, 5 failures [seed: DFB84CB763494660]

Total time: 4 minutes 12 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   3/5 failed: org.apache.solr.cloud.TestSkipOverseerOperations
[repro]   5/5 failed: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=08ca54f1f89eb98f6a3238f0f91c1f8383c12119, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #22616
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2