You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/10/24 10:04:21 UTC

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.4) - Build # 23084 - Still Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23084/
Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseParallelGC

13 tests failed.
FAILED:  org.apache.solr.client.solrj.impl.CloudSolrClientTest.testRouting

Error Message:
Error from server at https://127.0.0.1:34599/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title> </head> <body><h2>HTTP ERROR 404</h2> <p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason: <pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>  </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:34599/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

	at __randomizedtesting.SeedInfo.seed([A5313ACFDCEA8AE7:678606A7DFAA7A9F]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:551)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1016)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testRouting(CloudSolrClientTest.java:238)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:34599/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:528)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	... 1 more


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:38495/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:38495/solr
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA:C21C10DED643995D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:43437/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:43437/solr
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA:C21C10DED643995D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:36241/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:36241/solr
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA:C21C10DED643995D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:36887/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:36887/solr
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA:C21C10DED643995D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:46345/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:46345/solr
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA:C21C10DED643995D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:36273/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:36273/solr
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA:C21C10DED643995D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([3EC6972FB1353FA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12876 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestTlogReplica
   [junit4]   2> 294510 INFO  (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3EC6972FB1353FA-001/init-core-data-001
   [junit4]   2> 294513 WARN  (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 294514 INFO  (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 294514 INFO  (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 294515 INFO  (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3EC6972FB1353FA-001/tempDir-001
   [junit4]   2> 294515 INFO  (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 294523 INFO  (Thread-499) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 294523 INFO  (Thread-499) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 294537 ERROR (Thread-499) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 294623 INFO  (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:40147
   [junit4]   2> 294625 INFO  (zkConnectionManagerCallback-1461-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294629 INFO  (jetty-launcher-1458-thread-2) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9.0.4+11
   [junit4]   2> 294629 INFO  (jetty-launcher-1458-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9.0.4+11
   [junit4]   2> 294629 INFO  (jetty-launcher-1458-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 294629 INFO  (jetty-launcher-1458-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 294629 INFO  (jetty-launcher-1458-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 294629 INFO  (jetty-launcher-1458-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 294629 INFO  (jetty-launcher-1458-thread-2) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 294629 INFO  (jetty-launcher-1458-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 294630 INFO  (jetty-launcher-1458-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7d0d4d7b{/solr,null,AVAILABLE}
   [junit4]   2> 294630 INFO  (jetty-launcher-1458-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4312eb4a{/solr,null,AVAILABLE}
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@33cbfe56{SSL,[ssl, http/1.1]}{127.0.0.1:34213}
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3464ea60{SSL,[ssl, http/1.1]}{127.0.0.1:36273}
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-1) [    ] o.e.j.s.Server Started @294680ms
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-2) [    ] o.e.j.s.Server Started @294680ms
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34213}
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36273}
   [junit4]   2> 294631 ERROR (jetty-launcher-1458-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 294631 ERROR (jetty-launcher-1458-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-10-24T09:03:39.878725Z
   [junit4]   2> 294631 INFO  (jetty-launcher-1458-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-10-24T09:03:39.878741Z
   [junit4]   2> 294632 INFO  (zkConnectionManagerCallback-1464-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294632 INFO  (zkConnectionManagerCallback-1465-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294632 INFO  (jetty-launcher-1458-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 294632 INFO  (jetty-launcher-1458-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 294636 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100547b75610001, likely client has closed socket
   [junit4]   2> 294679 INFO  (jetty-launcher-1458-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40147/solr
   [junit4]   2> 294680 INFO  (zkConnectionManagerCallback-1469-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294681 INFO  (zkConnectionManagerCallback-1471-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294751 INFO  (jetty-launcher-1458-thread-2) [n:127.0.0.1:36273_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36273_solr
   [junit4]   2> 294751 INFO  (jetty-launcher-1458-thread-2) [n:127.0.0.1:36273_solr    ] o.a.s.c.Overseer Overseer (id=72150483264929796-127.0.0.1:36273_solr-n_0000000000) starting
   [junit4]   2> 294766 INFO  (zkConnectionManagerCallback-1478-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294767 INFO  (jetty-launcher-1458-thread-2) [n:127.0.0.1:36273_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40147/solr ready
   [junit4]   2> 294767 INFO  (OverseerStateUpdate-72150483264929796-127.0.0.1:36273_solr-n_0000000000) [n:127.0.0.1:36273_solr    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:36273_solr
   [junit4]   2> 294781 INFO  (jetty-launcher-1458-thread-2) [n:127.0.0.1:36273_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36273_solr
   [junit4]   2> 294786 INFO  (zkCallback-1470-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 294794 INFO  (zkCallback-1477-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 294805 INFO  (jetty-launcher-1458-thread-2) [n:127.0.0.1:36273_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 294820 INFO  (jetty-launcher-1458-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40147/solr
   [junit4]   2> 294821 INFO  (jetty-launcher-1458-thread-2) [n:127.0.0.1:36273_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36273.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2dc9ccaf
   [junit4]   2> 294828 INFO  (jetty-launcher-1458-thread-2) [n:127.0.0.1:36273_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36273.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2dc9ccaf
   [junit4]   2> 294828 INFO  (jetty-launcher-1458-thread-2) [n:127.0.0.1:36273_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36273.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2dc9ccaf
   [junit4]   2> 294829 INFO  (jetty-launcher-1458-thread-2) [n:127.0.0.1:36273_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3EC6972FB1353FA-001/tempDir-001/node2/.
   [junit4]   2> 294835 INFO  (zkConnectionManagerCallback-1483-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294853 INFO  (zkConnectionManagerCallback-1485-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294856 INFO  (jetty-launcher-1458-thread-1) [n:127.0.0.1:34213_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 294858 INFO  (jetty-launcher-1458-thread-1) [n:127.0.0.1:34213_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 294858 INFO  (jetty-launcher-1458-thread-1) [n:127.0.0.1:34213_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34213_solr
   [junit4]   2> 294866 INFO  (zkCallback-1470-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 294866 INFO  (zkCallback-1477-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 294866 INFO  (zkCallback-1484-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 294873 INFO  (zkConnectionManagerCallback-1492-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294874 INFO  (jetty-launcher-1458-thread-1) [n:127.0.0.1:34213_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 294874 INFO  (jetty-launcher-1458-thread-1) [n:127.0.0.1:34213_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40147/solr ready
   [junit4]   2> 294874 INFO  (jetty-launcher-1458-thread-1) [n:127.0.0.1:34213_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 294887 INFO  (jetty-launcher-1458-thread-1) [n:127.0.0.1:34213_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34213.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2dc9ccaf
   [junit4]   2> 294895 INFO  (jetty-launcher-1458-thread-1) [n:127.0.0.1:34213_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34213.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2dc9ccaf
   [junit4]   2> 294895 INFO  (jetty-launcher-1458-thread-1) [n:127.0.0.1:34213_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34213.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2dc9ccaf
   [junit4]   2> 294895 INFO  (jetty-launcher-1458-thread-1) [n:127.0.0.1:34213_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3EC6972FB1353FA-001/tempDir-001/node1/.
   [junit4]   2> 294915 INFO  (zkConnectionManagerCallback-1495-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294922 INFO  (zkConnectionManagerCallback-1500-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 294923 INFO  (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 294923 INFO  (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40147/solr ready
   [junit4]   2> 294925 INFO  (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.s.c.TestTlogReplica Using legacyCloud?: false
   [junit4]   2> 294941 INFO  (qtp1992517236-3686) [n:127.0.0.1:34213_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 294941 INFO  (qtp1992517236-3686) [n:127.0.0.1:34213_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 294952 INFO  (TEST-TestTlogReplica.testDeleteById-seed#[3EC6972FB1353FA]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteById
   [junit4]   2> 294955 INFO  (qtp1992517236-3684) [n:127.0.0.1:34213_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_delete_by_id&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 294970 INFO  (OverseerThreadFactory-1415-thread-1-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection tlog_replica_test_delete_by_id
   [junit4]   2> 295079 INFO  (qtp1992517236-3688) [n:127.0.0.1:34213_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 295093 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 295096 INFO  (OverseerStateUpdate-72150483264929796-127.0.0.1:36273_solr-n_0000000000) [n:127.0.0.1:36273_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"tlog_replica_test_delete_by_id",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"tlog_replica_test_delete_by_id_shard1_replica_t1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36273/solr",
   [junit4]   2>   "type":"TLOG",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 295098 INFO  (OverseerStateUpdate-72150483264929796-127.0.0.1:36273_solr-n_0000000000) [n:127.0.0.1:36273_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"tlog_replica_test_delete_by_id",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"tlog_replica_test_delete_by_id_shard1_replica_t2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34213/solr",
   [junit4]   2>   "type":"TLOG",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 295310 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr    x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 295311 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr    x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 295313 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr    x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 296318 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 296322 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.s.IndexSchema [tlog_replica_test_delete_by_id_shard1_replica_t1] Schema name=minimal
   [junit4]   2> 296323 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 296323 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 296323 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_delete_by_id_shard1_replica_t1' using configuration from collection tlog_replica_test_delete_by_id, trusted=true
   [junit4]   2> 296324 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36273.solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2dc9ccaf
   [junit4]   2> 296324 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SolrCore [[tlog_replica_test_delete_by_id_shard1_replica_t1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3EC6972FB1353FA-001/tempDir-001/node2/tlog_replica_test_delete_by_id_shard1_replica_t1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3EC6972FB1353FA-001/tempDir-001/node2/./tlog_replica_test_delete_by_id_shard1_replica_t1/data/]
   [junit4]   2> 296327 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.s.IndexSchema [tlog_replica_test_delete_by_id_shard1_replica_t2] Schema name=minimal
   [junit4]   2> 296347 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 296347 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_delete_by_id_shard1_replica_t2' using configuration from collection tlog_replica_test_delete_by_id, trusted=true
   [junit4]   2> 296348 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34213.solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2' (registry 'solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2dc9ccaf
   [junit4]   2> 296348 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.SolrCore [[tlog_replica_test_delete_by_id_shard1_replica_t2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3EC6972FB1353FA-001/tempDir-001/node1/tlog_replica_test_delete_by_id_shard1_replica_t2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3EC6972FB1353FA-001/tempDir-001/node1/./tlog_replica_test_delete_by_id_shard1_replica_t2/data/]
   [junit4]   2> 296382 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 296382 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 296383 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 296383 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 296384 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.s.SolrIndexSearcher Opening [Searcher@241aee12[tlog_replica_test_delete_by_id_shard1_replica_t1] main]
   [junit4]   2> 296385 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 296386 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 296386 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 296386 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1615196923240644608
   [junit4]   2> 296391 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_delete_by_id/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 296394 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 296398 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 296398 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 296398 INFO  (searcherExecutor-1427-thread-1-processing-n:127.0.0.1:36273_solr x:tlog_replica_test_delete_by_id_shard1_replica_t1 c:tlog_replica_test_delete_by_id s:shard1 r:core_node3) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t1] Registered new searcher Searcher@241aee12[tlog_replica_test_delete_by_id_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 296399 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 296399 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 296400 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.s.SolrIndexSearcher Opening [Searcher@6cc41115[tlog_replica_test_delete_by_id_shard1_replica_t2] main]
   [junit4]   2> 296402 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 296402 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 296402 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 296403 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1615196923258470400
   [junit4]   2> 296404 INFO  (searcherExecutor-1428-thread-1-processing-n:127.0.0.1:34213_solr x:tlog_replica_test_delete_by_id_shard1_replica_t2 c:tlog_replica_test_delete_by_id s:shard1 r:core_node4) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t2] Registered new searcher Searcher@6cc41115[tlog_replica_test_delete_by_id_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 296407 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_delete_by_id/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 296895 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 296895 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 296895 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:36273/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/
   [junit4]   2> 296895 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_delete_by_id_shard1_replica_t1 url=https://127.0.0.1:36273/solr START replicas=[https://127.0.0.1:34213/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/] nUpdates=100
   [junit4]   2> 296895 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_delete_by_id_shard1_replica_t1 url=https://127.0.0.1:36273/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 296898 INFO  (qtp1992517236-3750) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 296898 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 296898 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 296898 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t1 stopping background replication from leader
   [junit4]   2> 296900 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:36273/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/ shard1
   [junit4]   2> 297051 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 297053 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1744
   [junit4]   2> 297154 INFO  (zkCallback-1470-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 297410 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t2 starting background replication from leader
   [junit4]   2> 297410 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 297413 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 297413 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 297415 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2102
   [junit4]   2> 297417 INFO  (qtp1992517236-3684) [n:127.0.0.1:34213_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 297515 INFO  (zkCallback-1484-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 297515 INFO  (zkCallback-1470-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 298418 INFO  (qtp1992517236-3684) [n:127.0.0.1:34213_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_delete_by_id&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2} status=0 QTime=3463
   [junit4]   2> 298453 INFO  (qtp1992517236-3684) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&_version_=-1615196925386031104&distrib.from=https://127.0.0.1:36273/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&wt=javabin&version=2}{deleteByQuery=*:* (-1615196925386031104)} 0 1
   [junit4]   2> 298463 INFO  (qtp1848402425-3677) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1615196925418536960,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 298464 INFO  (qtp1848402425-3677) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 298465 INFO  (qtp1848402425-3677) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 298478 INFO  (qtp1848402425-3677) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:36273/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 14
   [junit4]   2> 298484 INFO  (qtp1992517236-3676) [n:127.0.0.1:34213_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:36273/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
   [junit4]   2> 298485 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_delete_by_id/terms/shard1 to Terms{values={core_node3=1, core_node4=1}, version=2}
   [junit4]   2> 298485 INFO  (qtp1848402425-3685) [n:127.0.0.1:36273_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1]  webapp=/solr path=/update params={_stateVer_=tlog_replica_test_delete_by_id:6&commit=true&wt=javabin&version=2}{deleteByQuery=*:* (-1615196925386031104),commit=} 0 53


[...truncated too long message...]

50683707375641-127.0.0.1:37583_solr-n_0000000005) [n:127.0.0.1:37583_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37583_solr
   [junit4]   2> 206715 WARN  (OverseerAutoScalingTriggerThread-72150683707375641-127.0.0.1:37583_solr-n_0000000005) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 206716 INFO  (jetty-closer-140-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 206716 INFO  (jetty-closer-140-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5d1e0b79: rootName = solr_36887, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@46eaa085
   [junit4]   2> 206717 INFO  (jetty-closer-140-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36887_solr
   [junit4]   2> 206717 INFO  (zkCallback-258-thread-2) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36887_solr
   [junit4]   2> 206717 INFO  (jetty-closer-140-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6a211994{/solr,null,UNAVAILABLE}
   [junit4]   2> 206717 INFO  (jetty-closer-140-thread-2) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 206718 INFO  (jetty-closer-140-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 206718 INFO  (zkCallback-258-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 206718 INFO  (zkCallback-265-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 206720 INFO  (jetty-closer-140-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2e3c4311{/solr,null,UNAVAILABLE}
   [junit4]   2> 206721 INFO  (jetty-closer-140-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 206721 ERROR (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 206721 INFO  (SUITE-TestTlogReplica-seed#[3EC6972FB1353FA]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35315 35315
   [junit4]   2> 206829 INFO  (Thread-102) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35315 35315
   [junit4]   2> 206830 WARN  (Thread-102) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	31	/solr/configs/conf
   [junit4]   2> 	30	/solr/collections/tlog_replica_test_create_delete/terms/shard2
   [junit4]   2> 	30	/solr/collections/tlog_replica_test_create_delete/terms/shard1
   [junit4]   2> 	19	/solr/collections/tlog_replica_test_recovery/terms/shard1
   [junit4]   2> 	19	/solr/collections/tlog_replica_test_remove_leader/terms/shard1
   [junit4]   2> 	17	/solr/collections/tlog_replica_test_basic_leader_election/terms/shard1
   [junit4]   2> 	16	/solr/collections/tlog_replica_test_kill_leader/terms/shard1
   [junit4]   2> 	16	/solr/collections/tlog_replica_test_kill_tlog_replica/terms/shard1
   [junit4]   2> 	15	/solr/aliases.json
   [junit4]   2> 	13	/solr/collections/tlog_replica_test_real_time_get/terms/shard1
   [junit4]   2> 	10	/solr/collections/tlog_replica_test_delete_by_id/terms/shard1
   [junit4]   2> 	10	/solr/collections/tlog_replica_test_only_leader_indexes/terms/shard1
   [junit4]   2> 	7	/solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/terms/shard1
   [junit4]   2> 	7	/solr/security.json
   [junit4]   2> 	6	/solr/collections/tlog_replica_test_add_remove_tlog_replica/terms/shard2
   [junit4]   2> 	5	/solr/collections/tlog_replica_test_add_remove_tlog_replica/terms/shard1
   [junit4]   2> 	4	/solr/collections/tlog_replica_test_add_docs/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	21	/solr/collections/tlog_replica_test_create_delete/state.json
   [junit4]   2> 	15	/solr/clusterprops.json
   [junit4]   2> 	15	/solr/clusterstate.json
   [junit4]   2> 	13	/solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json
   [junit4]   2> 	11	/solr/collections/tlog_replica_test_recovery/state.json
   [junit4]   2> 	11	/solr/collections/tlog_replica_test_basic_leader_election/state.json
   [junit4]   2> 	9	/solr/collections/tlog_replica_test_remove_leader/state.json
   [junit4]   2> 	8	/solr/collections/tlog_replica_test_kill_leader/state.json
   [junit4]   2> 	5	/solr/collections/tlog_replica_test_kill_tlog_replica/state.json
   [junit4]   2> 	4	/solr/autoscaling.json
   [junit4]   2> 	4	/solr/collections/tlog_replica_test_real_time_get/state.json
   [junit4]   2> 	3	/solr/overseer_elect/election/72150683707375629-127.0.0.1:36887_solr-n_0000000002
   [junit4]   2> 	3	/solr/collections/tlog_replica_test_add_remove_tlog_replica/state.json
   [junit4]   2> 	3	/solr/collections/tlog_replica_test_only_leader_indexes/state.json
   [junit4]   2> 	3	/solr/collections/tlog_replica_test_delete_by_id/state.json
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/72150683707375637-core_node11-n_0000000000
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_add_docs/state.json
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_recovery/leader_elect/shard1/election/72150683707375641-core_node3-n_0000000000
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/72150683707375629-core_node13-n_0000000001
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/72150683707375629-core_node15-n_0000000002
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/72150683707375637-core_node9-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	15	/solr/live_nodes
   [junit4]   2> 	15	/solr/collections
   [junit4]   2> 	4	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	4	/solr/overseer/queue
   [junit4]   2> 	4	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	4	/solr/overseer/queue-work
   [junit4]   2> 	3	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_3EC6972FB1353FA-002
   [junit4]   2> Oct 24, 2018 9:56:17 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): {foo=PostingsFormat(name=MockRandom), title_s=FST50, id=PostingsFormat(name=Direct), foo_s=PostingsFormat(name=MockRandom)}, docValues:{_version_=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Lucene70), inplace_updatable_int=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=1024, maxMBSortInHeap=5.930022932894586, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@2eed6cbd), locale=ewo, timezone=America/Dominica
   [junit4]   2> NOTE: Linux 4.15.0-36-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=273710192,total=524288000
   [junit4]   2> NOTE: All tests run in this JVM: [QueryEqualityTest, QueryEqualityTest, QueryEqualityTest, TestTlogReplica, TestTlogReplica]
   [junit4] Completed [10/10 (10!)] on J2 in 99.59s, 13 tests, 1 failure <<< FAILURES!

[...truncated 20 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 10 suites, 520 tests, 5 suite-level errors, 5 failures [seed: 3EC6972FB1353FA]

Total time: 3 minutes 30 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.client.solrj.impl.CloudSolrClientTest
[repro]   5/5 failed: org.apache.solr.cloud.TestTlogReplica
[repro]   5/5 failed: org.apache.solr.search.QueryEqualityTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=e083b1501ebe21abaf95bcd93f89af12142fd1ee, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23083
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-12-ea+12) - Build # 23093 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23093/
Java: 64bit/jdk-12-ea+12 -XX:-UseCompressedOops -XX:+UseParallelGC

55 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
14 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest:     1) Thread[id=1981, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:37371), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    2) Thread[id=309, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    3) Thread[id=1980, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    4) Thread[id=321, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    5) Thread[id=1986, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    6) Thread[id=1987, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    7) Thread[id=324, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    8) Thread[id=312, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    9) Thread[id=308, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   10) Thread[id=1983, name=zkConnectionManagerCallback-980-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   11) Thread[id=307, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:37371), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)   12) Thread[id=313, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   13) Thread[id=306, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   14) Thread[id=1982, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 14 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest: 
   1) Thread[id=1981, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:37371), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   2) Thread[id=309, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   3) Thread[id=1980, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   4) Thread[id=321, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   5) Thread[id=1986, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   6) Thread[id=1987, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   7) Thread[id=324, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   8) Thread[id=312, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   9) Thread[id=308, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
  10) Thread[id=1983, name=zkConnectionManagerCallback-980-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  11) Thread[id=307, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:37371), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
  12) Thread[id=313, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  13) Thread[id=306, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  14) Thread[id=1982, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=1981, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:37371), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    2) Thread[id=309, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    3) Thread[id=1983, name=zkConnectionManagerCallback-980-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    4) Thread[id=307, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:37371), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=1981, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:37371), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   2) Thread[id=309, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   3) Thread[id=1983, name=zkConnectionManagerCallback-980-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   4) Thread[id=307, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:37371), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
14 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest:     1) Thread[id=2005, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    2) Thread[id=2002, name=zkConnectionManagerCallback-988-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    3) Thread[id=2001, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)    4) Thread[id=2006, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    5) Thread[id=307, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    6) Thread[id=323, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    7) Thread[id=310, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    8) Thread[id=304, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    9) Thread[id=311, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   10) Thread[id=306, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   11) Thread[id=320, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   12) Thread[id=2000, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:40373), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)   13) Thread[id=1999, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   14) Thread[id=305, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:40373), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230)         at app//org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1249)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1173)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 14 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest: 
   1) Thread[id=2005, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   2) Thread[id=2002, name=zkConnectionManagerCallback-988-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   3) Thread[id=2001, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   4) Thread[id=2006, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   5) Thread[id=307, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   6) Thread[id=323, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   7) Thread[id=310, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   8) Thread[id=304, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   9) Thread[id=311, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  10) Thread[id=306, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
  11) Thread[id=320, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  12) Thread[id=2000, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:40373), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
  13) Thread[id=1999, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  14) Thread[id=305, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:40373), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1249)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1173)
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=2002, name=zkConnectionManagerCallback-988-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    2) Thread[id=2000, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:40373), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    3) Thread[id=307, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    4) Thread[id=305, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:40373), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=2002, name=zkConnectionManagerCallback-988-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   2) Thread[id=2000, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:40373), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   3) Thread[id=307, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   4) Thread[id=305, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:40373), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
8 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest:     1) Thread[id=305, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    2) Thread[id=302, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    3) Thread[id=315, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    4) Thread[id=308, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    5) Thread[id=309, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    6) Thread[id=320, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    7) Thread[id=304, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)    8) Thread[id=303, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:46669), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 8 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest: 
   1) Thread[id=305, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   2) Thread[id=302, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   3) Thread[id=315, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   4) Thread[id=308, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   5) Thread[id=309, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   6) Thread[id=320, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   7) Thread[id=304, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   8) Thread[id=303, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:46669), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=305, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    2) Thread[id=303, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:46669), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=305, name=zkConnectionManagerCallback-131-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   2) Thread[id=303, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[A035ADB66C5FCE8E]-SendThread(127.0.0.1:46669), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E]:0)


FAILED:  org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelShuffleStream

Error Message:
java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:37015/solr/collection1_shard2_replica_n3/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f&sort=a_f+asc,+a_i+asc&partitionKeys=a_f&qt=/export&distrib=false

Stack Trace:
java.io.IOException: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:37015/solr/collection1_shard2_replica_n3/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f&sort=a_f+asc,+a_i+asc&partitionKeys=a_f&qt=/export&distrib=false
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E:22E4D974395397F6]:0)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:400)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.open(CloudSolrStream.java:275)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.getTuples(StreamDecoratorTest.java:3954)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelShuffleStream(StreamDecoratorTest.java:1368)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:835)
Caused by: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:37015/solr/collection1_shard2_replica_n3/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f&sort=a_f+asc,+a_i+asc&partitionKeys=a_f&qt=/export&distrib=false
	at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:394)
	... 41 more
Caused by: java.io.IOException: --> https://127.0.0.1:37015/solr/collection1_shard2_replica_n3/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f&sort=a_f+asc,+a_i+asc&partitionKeys=a_f&qt=/export&distrib=false
	at org.apache.solr.client.solrj.io.stream.SolrStream.read(SolrStream.java:215)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$TupleWrapper.next(CloudSolrStream.java:484)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:507)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:494)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more


FAILED:  org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelIntersectStream

Error Message:
java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:40341/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setB+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc&partitionKeys=a_i&distrib=false

Stack Trace:
java.io.IOException: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:40341/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setB+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc&partitionKeys=a_i&distrib=false
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E:B72DC68705E0CBF3]:0)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:400)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.open(CloudSolrStream.java:275)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.getTuples(StreamDecoratorTest.java:3954)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelIntersectStream(StreamDecoratorTest.java:3707)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:835)
Caused by: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:40341/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setB+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc&partitionKeys=a_i&distrib=false
	at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:394)
	... 41 more
Caused by: java.io.IOException: --> https://127.0.0.1:40341/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setB+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc&partitionKeys=a_i&distrib=false
	at org.apache.solr.client.solrj.io.stream.SolrStream.read(SolrStream.java:215)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$TupleWrapper.next(CloudSolrStream.java:484)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:507)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:494)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more


FAILED:  org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelComplementStream

Error Message:
java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:40641/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false

Stack Trace:
java.io.IOException: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:40641/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E:954B209BC26D2714]:0)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:400)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.open(CloudSolrStream.java:275)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.getTuples(StreamDecoratorTest.java:3954)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelComplementStream(StreamDecoratorTest.java:3942)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:835)
Caused by: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:40641/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false
	at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:394)
	... 41 more
Caused by: java.io.IOException: --> https://127.0.0.1:40641/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false
	at org.apache.solr.client.solrj.io.stream.SolrStream.read(SolrStream.java:215)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$TupleWrapper.next(CloudSolrStream.java:484)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:507)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:494)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more


FAILED:  org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelIntersectStream

Error Message:
java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:32981/solr/collection1_shard2_replica_n2/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false

Stack Trace:
java.io.IOException: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:32981/solr/collection1_shard2_replica_n2/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E:B72DC68705E0CBF3]:0)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:400)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.open(CloudSolrStream.java:275)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.getTuples(StreamDecoratorTest.java:3954)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelIntersectStream(StreamDecoratorTest.java:3707)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:835)
Caused by: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:32981/solr/collection1_shard2_replica_n2/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false
	at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:394)
	... 41 more
Caused by: java.io.IOException: --> https://127.0.0.1:32981/solr/collection1_shard2_replica_n2/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false
	at org.apache.solr.client.solrj.io.stream.SolrStream.read(SolrStream.java:215)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$TupleWrapper.next(CloudSolrStream.java:484)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:507)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:494)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more


FAILED:  org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelComplementStream

Error Message:
java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:46785/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false

Stack Trace:
java.io.IOException: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:46785/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E:954B209BC26D2714]:0)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:400)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.open(CloudSolrStream.java:275)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.getTuples(StreamDecoratorTest.java:3954)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelComplementStream(StreamDecoratorTest.java:3942)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:835)
Caused by: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:46785/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false
	at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:394)
	... 41 more
Caused by: java.io.IOException: --> https://127.0.0.1:46785/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false
	at org.apache.solr.client.solrj.io.stream.SolrStream.read(SolrStream.java:215)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$TupleWrapper.next(CloudSolrStream.java:484)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:507)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:494)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more


FAILED:  org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelNullStream

Error Message:
java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:46785/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f&sort=a_f+asc&partitionKeys=id&distrib=false

Stack Trace:
java.io.IOException: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:46785/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f&sort=a_f+asc&partitionKeys=id&distrib=false
	at __randomizedtesting.SeedInfo.seed([A035ADB66C5FCE8E:CF682090637F1CF0]:0)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:400)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.open(CloudSolrStream.java:275)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.getTuples(StreamDecoratorTest.java:3954)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelNullStream(StreamDecoratorTest.java:286)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:835)
Caused by: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:46785/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f&sort=a_f+asc&partitionKeys=id&distrib=false
	at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:394)
	... 41 more
Caused by: java.io.IOException: --> https://127.0.0.1:46785/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f&sort=a_f+asc&partitionKeys=id&distrib=false
	at org.apache.solr.client.solrj.io.stream.SolrStream.read(SolrStream.java:215)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$TupleWrapper.next(CloudSolrStream.java:484)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:507)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:494)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execu

[...truncated too long message...]

orters for registry=solr.collection.testSimple3.shard2.leader, tag=105ae9c8
   [junit4]   2> 690391 DEBUG (coreCloseExecutor-1769-thread-5) [n:127.0.0.1:38721_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.c.ZkController removed listener for config directory [/configs/conf]
   [junit4]   2> 690391 DEBUG (coreCloseExecutor-1769-thread-5) [n:127.0.0.1:38721_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.c.ZkController No more listeners for config directory [/configs/conf]
   [junit4]   2> 690392 INFO  (jetty-closer-869-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72158963315834885-127.0.0.1:38721_solr-n_0000000000) closing
   [junit4]   2> 690392 INFO  (OverseerStateUpdate-72158963315834885-127.0.0.1:38721_solr-n_0000000000) [n:127.0.0.1:38721_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38721_solr
   [junit4]   2> 690392 WARN  (OverseerAutoScalingTriggerThread-72158963315834885-127.0.0.1:38721_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 690393 DEBUG (jetty-closer-869-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 690393 DEBUG (jetty-closer-869-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 690393 DEBUG (jetty-closer-869-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 690393 DEBUG (jetty-closer-869-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
   [junit4]   2> 690393 DEBUG (jetty-closer-869-thread-1) [    ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 690393 DEBUG (jetty-closer-869-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 690393 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch fired: create/delete: /solr/overseer_elect/election/72158963315834885-127.0.0.1:38721_solr-n_0000000000
   [junit4]   2> 690394 INFO  (zkCallback-935-thread-3) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46749_solr
   [junit4]   2> 690394 INFO  (jetty-closer-869-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@56d4bb86{/solr,null,UNAVAILABLE}
   [junit4]   2> 690394 INFO  (jetty-closer-869-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 691848 WARN  (zkCallback-942-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 691849 INFO  (jetty-closer-869-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5300df1{/solr,null,UNAVAILABLE}
   [junit4]   2> 691849 INFO  (jetty-closer-869-thread-2) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 691850 ERROR (SUITE-AutoAddReplicasIntegrationTest-seed#[89FC6ED6A986AE07]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 691850 INFO  (SUITE-AutoAddReplicasIntegrationTest-seed#[89FC6ED6A986AE07]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34633 34633
   [junit4]   2> 691957 INFO  (Thread-525) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34633 34633
   [junit4]   2> 691958 WARN  (Thread-525) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/aliases.json
   [junit4]   2> 	9	/solr/collections/testSimple1/terms/shard2
   [junit4]   2> 	9	/solr/collections/testSimple1/terms/shard1
   [junit4]   2> 	8	/solr/collections/testSimple2/terms/shard2
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf
   [junit4]   2> 	3	/solr/collections/testSimple2/terms/shard1
   [junit4]   2> 	2	/solr/collections/testSimple3/terms/shard3
   [junit4]   2> 	2	/solr/collections/testSimple3/terms/shard2
   [junit4]   2> 	2	/solr/collections/testSimple3/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	38	/solr/collections/testSimple1/state.json
   [junit4]   2> 	11	/solr/clusterprops.json
   [junit4]   2> 	11	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/collections/testSimple3/state.json
   [junit4]   2> 	3	/solr/collections/testSimple2/state.json
   [junit4]   2> 	3	/solr/collections/testSimple1/leader_elect/shard2/election/72158963315834885-core_node8-n_0000000000
   [junit4]   2> 	3	/solr/collections/testSimple1/leader_elect/shard1/election/72158963315834885-core_node5-n_0000000000
   [junit4]   2> 	3	/solr/overseer_elect/election/72158963315834885-127.0.0.1:38721_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/live_nodes
   [junit4]   2> 	11	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_89FC6ED6A986AE07-002
   [junit4]   2> Oct 25, 2018 9:03:05 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): {}, docValues:{}, maxPointsInLeafNode=457, maxMBSortInHeap=7.969353058606812, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@5c4a6104), locale=es-ES, timezone=Europe/Moscow
   [junit4]   2> NOTE: Linux 4.15.0-36-generic amd64/Oracle Corporation 12-ea (64-bit)/cpus=8,threads=1,free=229832912,total=470286336
   [junit4]   2> NOTE: All tests run in this JVM: [TestTlogReplica, AutoAddReplicasIntegrationTest, SplitShardTest, TestMiniSolrCloudClusterSSL, SplitShardTest, TestSimPolicyCloud, TestTlogReplica, AutoAddReplicasIntegrationTest]
   [junit4] Completed [30/30 (19!)] on J2 in 170.70s, 1 test, 1 failure <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 89FC6ED6A986AE07] (first 10 out of 26):
   [junit4]   - org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple
   [junit4]   - org.apache.solr.cloud.TestTlogReplica.testRecovery
   [junit4]   - org.apache.solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest.testSimple
   [junit4]   - org.apache.solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest.testSimple
   [junit4]   - org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth
   [junit4]   - org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslWithInvalidPeerName
   [junit4]   - org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName
   [junit4]   - org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple
   [junit4]   - org.apache.solr.cloud.TestTlogReplica.testRecovery
   [junit4]   - org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.76 ..   683.21 =   682.45s
   [junit4] JVM J1:     0.78 ..   668.03 =   667.25s
   [junit4] JVM J2:     0.75 ..   693.40 =   692.65s
   [junit4] Execution time total: 11 minutes 33 seconds
   [junit4] Tests summary: 30 suites, 150 tests, 13 errors, 13 failures

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 30 suites, 150 tests, 13 errors, 13 failures [seed: 89FC6ED6A986AE07]

Total time: 11 minutes 35 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestSimPolicyCloud
[repro]   2/5 failed: org.apache.solr.cloud.SplitShardTest
[repro]   3/5 failed: org.apache.solr.client.solrj.io.stream.StreamDecoratorTest
[repro]   4/5 failed: org.apache.solr.cloud.TestTlogReplica
[repro]   4/5 failed: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest
[repro]   4/5 failed: org.apache.solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest
[repro]   5/5 failed: org.apache.solr.cloud.TestMiniSolrCloudClusterSSL
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=8d109393492924cdde9663b9b9c4da00daaae433, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23092
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-11) - Build # 23092 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23092/
Java: 64bit/jdk-11 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

39 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest

Error Message:
Could not find collection : AutoscalingHistoryHandlerTest_collection

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : AutoscalingHistoryHandlerTest_collection
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:118)
	at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:258)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.waitForRecovery(AutoscalingHistoryHandlerTest.java:403)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.setupCluster(AutoscalingHistoryHandlerTest.java:97)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest

Error Message:
Could not find collection : AutoscalingHistoryHandlerTest_collection

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : AutoscalingHistoryHandlerTest_collection
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:118)
	at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:258)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.waitForRecovery(AutoscalingHistoryHandlerTest.java:403)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.setupCluster(AutoscalingHistoryHandlerTest.java:97)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest

Error Message:
Could not find collection : AutoscalingHistoryHandlerTest_collection

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : AutoscalingHistoryHandlerTest_collection
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:118)
	at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:258)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.waitForRecovery(AutoscalingHistoryHandlerTest.java:403)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.setupCluster(AutoscalingHistoryHandlerTest.java:97)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.schema.SchemaApiFailureTest

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2]:0)
	at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1474)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:450)
	at org.apache.solr.schema.SchemaApiFailureTest.setupCluster(SchemaApiFailureTest.java:43)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.schema.SchemaApiFailureTest

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2]:0)
	at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1474)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:450)
	at org.apache.solr.schema.SchemaApiFailureTest.setupCluster(SchemaApiFailureTest.java:43)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.schema.SchemaApiFailureTest

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2]:0)
	at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1474)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:450)
	at org.apache.solr.schema.SchemaApiFailureTest.setupCluster(SchemaApiFailureTest.java:43)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.schema.SchemaApiFailureTest

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2]:0)
	at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1474)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:450)
	at org.apache.solr.schema.SchemaApiFailureTest.setupCluster(SchemaApiFailureTest.java:43)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.schema.SchemaApiFailureTest

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2]:0)
	at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1474)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:450)
	at org.apache.solr.schema.SchemaApiFailureTest.setupCluster(SchemaApiFailureTest.java:43)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.SplitShardTest.doTest

Error Message:
Error from server at https://127.0.0.1:40381/solr: SPLITSHARD timed out waiting for subshard leaders to come up

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:40381/solr: SPLITSHARD timed out waiting for subshard leaders to come up
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:95B24D260FDFF6B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.SplitShardTest.doTest(SplitShardTest.java:64)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.SplitShardTest.doTest

Error Message:
Error from server at https://127.0.0.1:42961/solr: SPLITSHARD timed out waiting for subshard leaders to come up

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:42961/solr: SPLITSHARD timed out waiting for subshard leaders to come up
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:95B24D260FDFF6B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.SplitShardTest.doTest(SplitShardTest.java:64)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.SplitShardTest.doTest

Error Message:
Error from server at https://127.0.0.1:42609/solr: Could not find collection : splitshardtest-collection

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:42609/solr: Could not find collection : splitshardtest-collection
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:95B24D260FDFF6B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.SplitShardTest.doTest(SplitShardTest.java:64)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.SplitShardTest.doTest

Error Message:
Error from server at https://127.0.0.1:39193/solr: SPLITSHARD timed out waiting for subshard leaders to come up

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:39193/solr: SPLITSHARD timed out waiting for subshard leaders to come up
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:95B24D260FDFF6B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.SplitShardTest.doTest(SplitShardTest.java:64)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.SplitShardTest.doTest

Error Message:
Error from server at https://127.0.0.1:37409/solr: Could not find collection : splitshardtest-collection

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37409/solr: Could not find collection : splitshardtest-collection
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:95B24D260FDFF6B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.SplitShardTest.doTest(SplitShardTest.java:64)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth

Error Message:
Could not find collection:second_collection

Stack Trace:
java.lang.AssertionError: Could not find collection:second_collection
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:52A54842F5665D18]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkCreateCollection(TestMiniSolrCloudClusterSSL.java:263)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithCollectionCreations(TestMiniSolrCloudClusterSSL.java:249)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithNodeReplacement(TestMiniSolrCloudClusterSSL.java:157)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth(TestMiniSolrCloudClusterSSL.java:121)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth

Error Message:
Could not find collection:second_collection

Stack Trace:
java.lang.AssertionError: Could not find collection:second_collection
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:52A54842F5665D18]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkCreateCollection(TestMiniSolrCloudClusterSSL.java:263)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithCollectionCreations(TestMiniSolrCloudClusterSSL.java:249)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithNodeReplacement(TestMiniSolrCloudClusterSSL.java:157)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth(TestMiniSolrCloudClusterSSL.java:121)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslWithInvalidPeerName

Error Message:
Could not find collection:second_collection

Stack Trace:
java.lang.AssertionError: Could not find collection:second_collection
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:F9AED9CDCDBA13C3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkCreateCollection(TestMiniSolrCloudClusterSSL.java:263)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithCollectionCreations(TestMiniSolrCloudClusterSSL.java:249)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslWithInvalidPeerName(TestMiniSolrCloudClusterSSL.java:185)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth

Error Message:
Could not find collection:second_collection

Stack Trace:
java.lang.AssertionError: Could not find collection:second_collection
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:52A54842F5665D18]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkCreateCollection(TestMiniSolrCloudClusterSSL.java:263)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithCollectionCreations(TestMiniSolrCloudClusterSSL.java:249)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithNodeReplacement(TestMiniSolrCloudClusterSSL.java:157)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth(TestMiniSolrCloudClusterSSL.java:121)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslWithInvalidPeerName

Error Message:
Could not find collection:second_collection

Stack Trace:
java.lang.AssertionError: Could not find collection:second_collection
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:F9AED9CDCDBA13C3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkCreateCollection(TestMiniSolrCloudClusterSSL.java:263)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithCollectionCreations(TestMiniSolrCloudClusterSSL.java:249)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslWithInvalidPeerName(TestMiniSolrCloudClusterSSL.java:185)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitShardWithRule

Error Message:
Error from server at https://127.0.0.1:45087/_vj/v: Unable to call distrib softCommit on: https://127.0.0.1:45087/_vj/v/shardSplitWithRule_rewrite_shard1_replica_n1/

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:45087/_vj/v: Unable to call distrib softCommit on: https://127.0.0.1:45087/_vj/v/shardSplitWithRule_rewrite_shard1_replica_n1/
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:2F114DC490B4B7F9]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.api.collections.ShardSplitTest.doSplitShardWithRule(ShardSplitTest.java:633)
	at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitShardWithRule(ShardSplitTest.java:607)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitLocking

Error Message:
expected to fail due to locking but succeeded

Stack Trace:
java.lang.AssertionError: expected to fail due to locking but succeeded
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:C9586B871D739257]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitLocking(ShardSplitTest.java:583)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.api.collections.ShardSplitTest.test

Error Message:
Could not find new collection routeFieldColl

Stack Trace:
java.lang.AssertionError: Could not find new collection routeFieldColl
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:264BA3ACA3BA812A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkForCollection(AbstractFullDistribZkTestBase.java:1822)
	at org.apache.solr.cloud.api.collections.ShardSplitTest.splitByRouteFieldTest(ShardSplitTest.java:791)
	at org.apache.solr.cloud.api.collections.ShardSplitTest.test(ShardSplitTest.java:111)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.api.collections.ShardSplitTest.test

Error Message:
Could not find new collection routeFieldColl

Stack Trace:
java.lang.AssertionError: Could not find new collection routeFieldColl
	at __randomizedtesting.SeedInfo.seed([AE1F9C760D46ECD2:264BA3ACA3BA812A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkForCollection(AbstractFullDistribZkTestBase.java:1822)
	at org.apache.solr.cloud.api.collections.ShardSplitTest.splitByRouteFieldTest(ShardSplitTest.java:791)
	at org.apache.solr.cloud.api.collections.ShardSplitTest.test(ShardSplitTest.java:111)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtest

[...truncated too long message...]

.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
   [junit4]    > 	at org.apache.solr.cloud.SplitShardTest.doTest(SplitShardTest.java:64)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:834)
   [junit4]   2> 1730281 WARN  (zkCallback-3369-thread-3) [    ] o.a.s.c.c.ZkStateReader$AliasesManager ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /aliases.json]
   [junit4]   2> 1730283 INFO  (jetty-closer-3345-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1eef11e2{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1730283 INFO  (jetty-closer-3345-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=813265366
   [junit4]   2> 1730283 INFO  (jetty-closer-3345-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1730283 INFO  (jetty-closer-3345-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3dffbf9a: rootName = solr_42609, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2ab30d9c
   [junit4]   2> 1730287 INFO  (jetty-closer-3345-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1730287 INFO  (jetty-closer-3345-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@734a7e43: rootName = solr_42609, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7fb1e19d
   [junit4]   2> 1730290 INFO  (jetty-closer-3345-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1730290 INFO  (jetty-closer-3345-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6ab6b2ff: rootName = solr_42609, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@3ab3600f
   [junit4]   2> 1730291 INFO  (jetty-closer-3345-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:42609_solr
   [junit4]   2> 1730291 INFO  (jetty-closer-3345-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1730291 INFO  (zkCallback-3354-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 1730291 INFO  (zkCallback-3361-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 1730291 INFO  (jetty-closer-3345-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72158091481317379-127.0.0.1:42609_solr-n_0000000000) closing
   [junit4]   2> 1730291 INFO  (OverseerStateUpdate-72158091481317379-127.0.0.1:42609_solr-n_0000000000) [n:127.0.0.1:42609_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:42609_solr
   [junit4]   2> 1730292 WARN  (OverseerAutoScalingTriggerThread-72158091481317379-127.0.0.1:42609_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1730293 INFO  (jetty-closer-3345-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@51ebb8b7{/solr,null,UNAVAILABLE}
   [junit4]   2> 1730293 INFO  (jetty-closer-3345-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1730293 ERROR (SUITE-SplitShardTest-seed#[AE1F9C760D46ECD2]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1730293 INFO  (SUITE-SplitShardTest-seed#[AE1F9C760D46ECD2]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41431 41431
   [junit4]   2> 1730319 INFO  (Thread-1916) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41431 41431
   [junit4]   2> 1730320 WARN  (Thread-1916) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	3	/solr/collections/splitshardtest-collection/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/collections
   [junit4]   2> 	5	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SplitShardTest_AE1F9C760D46ECD2-004
   [junit4]   2> Oct 25, 2018 5:19:06 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@5b63b75d), locale=en-SH, timezone=MET
   [junit4]   2> NOTE: Linux 4.15.0-36-generic amd64/Oracle Corporation 11 (64-bit)/cpus=8,threads=1,free=101238696,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestMiniSolrCloudClusterSSL, TestLocalFSCloudBackupRestore, ShardSplitTest, SplitShardTest, AutoscalingHistoryHandlerTest, ShardSplitTest, TestTlogReplica, AutoscalingHistoryHandlerTest, SplitShardTest, SplitShardTest, SplitShardTest]
   [junit4] Completed [35/35 (28!)] on J0 in 34.93s, 2 tests, 1 error <<< FAILURES!

[...truncated 1 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20181025_165015_6256096022692884462186.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 19 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 35 suites, 169 tests, 6 suite-level errors, 16 errors, 14 failures [seed: AE1F9C760D46ECD2]

Total time: 28 minutes 53 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   2/5 failed: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
[repro]   3/5 failed: org.apache.solr.cloud.api.collections.ShardSplitTest
[repro]   4/5 failed: org.apache.solr.cloud.SplitShardTest
[repro]   4/5 failed: org.apache.solr.schema.SchemaApiFailureTest
[repro]   5/5 failed: org.apache.solr.cloud.TestMiniSolrCloudClusterSSL
[repro]   5/5 failed: org.apache.solr.cloud.TestTlogReplica
[repro]   5/5 failed: org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=7952cec99aae943e89c7fd9f7329962a7285c3dd, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23091
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.4) - Build # 23091 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23091/
Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseG1GC

5 tests failed.
FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:43971/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:43971/solr
	at __randomizedtesting.SeedInfo.seed([8B7C26646A3CD05F:4A8C5FC8476C1AF8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:37161/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:37161/solr
	at __randomizedtesting.SeedInfo.seed([8B7C26646A3CD05F:4A8C5FC8476C1AF8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:45019/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:45019/solr
	at __randomizedtesting.SeedInfo.seed([8B7C26646A3CD05F:4A8C5FC8476C1AF8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:34181/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:34181/solr
	at __randomizedtesting.SeedInfo.seed([8B7C26646A3CD05F:4A8C5FC8476C1AF8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:44523/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:44523/solr
	at __randomizedtesting.SeedInfo.seed([8B7C26646A3CD05F:4A8C5FC8476C1AF8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12728 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestTlogReplica
   [junit4]   2> 28377 INFO  (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_8B7C26646A3CD05F-001/init-core-data-001
   [junit4]   2> 28377 WARN  (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=14 numCloses=14
   [junit4]   2> 28377 INFO  (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 28378 INFO  (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 28379 INFO  (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_8B7C26646A3CD05F-001/tempDir-001
   [junit4]   2> 28379 INFO  (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 28381 INFO  (Thread-40) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 28381 INFO  (Thread-40) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 28385 ERROR (Thread-40) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 28481 INFO  (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:37823
   [junit4]   2> 28509 INFO  (zkConnectionManagerCallback-71-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 28561 INFO  (jetty-launcher-68-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9.0.4+11
   [junit4]   2> 28561 INFO  (jetty-launcher-68-thread-2) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9.0.4+11
   [junit4]   2> 28591 INFO  (jetty-launcher-68-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 28591 INFO  (jetty-launcher-68-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 28592 INFO  (jetty-launcher-68-thread-1) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 28592 INFO  (jetty-launcher-68-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 28592 INFO  (jetty-launcher-68-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 28592 INFO  (jetty-launcher-68-thread-2) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 28593 INFO  (jetty-launcher-68-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4e8a62e6{/solr,null,AVAILABLE}
   [junit4]   2> 28593 INFO  (jetty-launcher-68-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2c371e61{/solr,null,AVAILABLE}
   [junit4]   2> 28600 INFO  (jetty-launcher-68-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@fd0b6a{SSL,[ssl, http/1.1]}{127.0.0.1:44523}
   [junit4]   2> 28600 INFO  (jetty-launcher-68-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7dbea58c{SSL,[ssl, http/1.1]}{127.0.0.1:38883}
   [junit4]   2> 28600 INFO  (jetty-launcher-68-thread-2) [    ] o.e.j.s.Server Started @28654ms
   [junit4]   2> 28600 INFO  (jetty-launcher-68-thread-1) [    ] o.e.j.s.Server Started @28654ms
   [junit4]   2> 28600 INFO  (jetty-launcher-68-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38883}
   [junit4]   2> 28600 INFO  (jetty-launcher-68-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44523}
   [junit4]   2> 28601 ERROR (jetty-launcher-68-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 28601 ERROR (jetty-launcher-68-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 28601 INFO  (jetty-launcher-68-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 28601 INFO  (jetty-launcher-68-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 28601 INFO  (jetty-launcher-68-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 28601 INFO  (jetty-launcher-68-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 28601 INFO  (jetty-launcher-68-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 28601 INFO  (jetty-launcher-68-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 28601 INFO  (jetty-launcher-68-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 28601 INFO  (jetty-launcher-68-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 28601 INFO  (jetty-launcher-68-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-10-25T12:01:06.385613Z
   [junit4]   2> 28601 INFO  (jetty-launcher-68-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-10-25T12:01:06.385632Z
   [junit4]   2> 28629 INFO  (zkConnectionManagerCallback-75-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 28643 INFO  (jetty-launcher-68-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 28644 INFO  (zkConnectionManagerCallback-74-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 28649 INFO  (jetty-launcher-68-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 28737 INFO  (jetty-launcher-68-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37823/solr
   [junit4]   2> 28760 INFO  (zkConnectionManagerCallback-79-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 28773 INFO  (zkConnectionManagerCallback-81-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 28876 INFO  (jetty-launcher-68-thread-1) [n:127.0.0.1:44523_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44523_solr
   [junit4]   2> 28876 INFO  (jetty-launcher-68-thread-1) [n:127.0.0.1:44523_solr    ] o.a.s.c.Overseer Overseer (id=72156843297275908-127.0.0.1:44523_solr-n_0000000000) starting
   [junit4]   2> 28926 INFO  (jetty-launcher-68-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37823/solr
   [junit4]   2> 28946 INFO  (zkConnectionManagerCallback-89-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 28949 INFO  (zkConnectionManagerCallback-92-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 28956 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1005a4444d90006, likely client has closed socket
   [junit4]   2> 28958 INFO  (jetty-launcher-68-thread-1) [n:127.0.0.1:44523_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37823/solr ready
   [junit4]   2> 28958 INFO  (OverseerStateUpdate-72156843297275908-127.0.0.1:44523_solr-n_0000000000) [n:127.0.0.1:44523_solr    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44523_solr
   [junit4]   2> 28965 INFO  (zkConnectionManagerCallback-94-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 28966 INFO  (jetty-launcher-68-thread-1) [n:127.0.0.1:44523_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44523_solr
   [junit4]   2> 28972 INFO  (jetty-launcher-68-thread-2) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 29007 INFO  (jetty-launcher-68-thread-2) [n:127.0.0.1:38883_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 29007 INFO  (jetty-launcher-68-thread-2) [n:127.0.0.1:38883_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38883_solr
   [junit4]   2> 29013 INFO  (zkCallback-80-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 29046 INFO  (zkCallback-88-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 29046 INFO  (zkCallback-93-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 29073 INFO  (jetty-launcher-68-thread-1) [n:127.0.0.1:44523_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 29085 INFO  (zkConnectionManagerCallback-102-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 29089 INFO  (jetty-launcher-68-thread-2) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 29090 INFO  (jetty-launcher-68-thread-2) [n:127.0.0.1:38883_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37823/solr ready
   [junit4]   2> 29096 INFO  (jetty-launcher-68-thread-2) [n:127.0.0.1:38883_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 29102 INFO  (jetty-launcher-68-thread-1) [n:127.0.0.1:44523_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44523.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@30c05a9
   [junit4]   2> 29118 INFO  (jetty-launcher-68-thread-2) [n:127.0.0.1:38883_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38883.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@30c05a9
   [junit4]   2> 29118 INFO  (jetty-launcher-68-thread-1) [n:127.0.0.1:44523_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44523.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@30c05a9
   [junit4]   2> 29118 INFO  (jetty-launcher-68-thread-1) [n:127.0.0.1:44523_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44523.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@30c05a9
   [junit4]   2> 29119 INFO  (jetty-launcher-68-thread-1) [n:127.0.0.1:44523_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_8B7C26646A3CD05F-001/tempDir-001/node1/.
   [junit4]   2> 29128 INFO  (jetty-launcher-68-thread-2) [n:127.0.0.1:38883_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38883.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@30c05a9
   [junit4]   2> 29130 INFO  (jetty-launcher-68-thread-2) [n:127.0.0.1:38883_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38883.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@30c05a9
   [junit4]   2> 29131 INFO  (jetty-launcher-68-thread-2) [n:127.0.0.1:38883_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_8B7C26646A3CD05F-001/tempDir-001/node2/.
   [junit4]   2> 29189 INFO  (zkConnectionManagerCallback-105-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 29209 INFO  (zkConnectionManagerCallback-110-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 29210 INFO  (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 29212 INFO  (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37823/solr ready
   [junit4]   2> 29215 INFO  (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.s.c.TestTlogReplica Using legacyCloud?: false
   [junit4]   2> 29246 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 29248 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 29278 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testKillLeader
   [junit4]   2> 29282 INFO  (qtp681124768-280) [n:127.0.0.1:44523_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_kill_leader&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 29283 INFO  (OverseerThreadFactory-166-thread-1-processing-n:127.0.0.1:44523_solr) [n:127.0.0.1:44523_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection tlog_replica_test_kill_leader
   [junit4]   2> 29402 INFO  (qtp681124768-289) [n:127.0.0.1:44523_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 29423 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 29429 INFO  (OverseerStateUpdate-72156843297275908-127.0.0.1:44523_solr-n_0000000000) [n:127.0.0.1:44523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"tlog_replica_test_kill_leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"tlog_replica_test_kill_leader_shard1_replica_t1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38883/solr",
   [junit4]   2>   "type":"TLOG",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 29433 INFO  (OverseerStateUpdate-72156843297275908-127.0.0.1:44523_solr-n_0000000000) [n:127.0.0.1:44523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"tlog_replica_test_kill_leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"tlog_replica_test_kill_leader_shard1_replica_t3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44523/solr",
   [junit4]   2>   "type":"TLOG",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 29544 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr    x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_leader_shard1_replica_t3&action=CREATE&numShards=1&collection=tlog_replica_test_kill_leader&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 29545 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr    x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 29556 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr    x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_leader_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_kill_leader&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 30564 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 30569 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 30570 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.s.IndexSchema [tlog_replica_test_kill_leader_shard1_replica_t3] Schema name=minimal
   [junit4]   2> 30572 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 30573 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_kill_leader_shard1_replica_t3' using configuration from collection tlog_replica_test_kill_leader, trusted=true
   [junit4]   2> 30573 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44523.solr.core.tlog_replica_test_kill_leader.shard1.replica_t3' (registry 'solr.core.tlog_replica_test_kill_leader.shard1.replica_t3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@30c05a9
   [junit4]   2> 30574 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.SolrCore [[tlog_replica_test_kill_leader_shard1_replica_t3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_8B7C26646A3CD05F-001/tempDir-001/node1/tlog_replica_test_kill_leader_shard1_replica_t3], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_8B7C26646A3CD05F-001/tempDir-001/node1/./tlog_replica_test_kill_leader_shard1_replica_t3/data/]
   [junit4]   2> 30584 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.s.IndexSchema [tlog_replica_test_kill_leader_shard1_replica_t1] Schema name=minimal
   [junit4]   2> 30586 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 30586 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_kill_leader_shard1_replica_t1' using configuration from collection tlog_replica_test_kill_leader, trusted=true
   [junit4]   2> 30587 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38883.solr.core.tlog_replica_test_kill_leader.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_kill_leader.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@30c05a9
   [junit4]   2> 30587 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.SolrCore [[tlog_replica_test_kill_leader_shard1_replica_t1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_8B7C26646A3CD05F-001/tempDir-001/node2/tlog_replica_test_kill_leader_shard1_replica_t1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_8B7C26646A3CD05F-001/tempDir-001/node2/./tlog_replica_test_kill_leader_shard1_replica_t1/data/]
   [junit4]   2> 30641 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 30641 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 30642 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 30642 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 30644 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.s.SolrIndexSearcher Opening [Searcher@53f966a5[tlog_replica_test_kill_leader_shard1_replica_t3] main]
   [junit4]   2> 30645 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 30646 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 30647 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 30649 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1615298684186001408
   [junit4]   2> 30649 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 30649 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 30650 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 30650 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 30652 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.s.SolrIndexSearcher Opening [Searcher@65d634ea[tlog_replica_test_kill_leader_shard1_replica_t1] main]
   [junit4]   2> 30652 INFO  (searcherExecutor-175-thread-1-processing-n:127.0.0.1:44523_solr x:tlog_replica_test_kill_leader_shard1_replica_t3 c:tlog_replica_test_kill_leader s:shard1 r:core_node4) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.SolrCore [tlog_replica_test_kill_leader_shard1_replica_t3] Registered new searcher Searcher@53f966a5[tlog_replica_test_kill_leader_shard1_replica_t3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 30653 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 30653 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 30654 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 30654 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1615298684191244288
   [junit4]   2> 30657 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_kill_leader/terms/shard1 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 30658 INFO  (searcherExecutor-176-thread-1-processing-n:127.0.0.1:38883_solr x:tlog_replica_test_kill_leader_shard1_replica_t1 c:tlog_replica_test_kill_leader s:shard1 r:core_node2) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.SolrCore [tlog_replica_test_kill_leader_shard1_replica_t1] Registered new searcher Searcher@65d634ea[tlog_replica_test_kill_leader_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 30661 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_kill_leader/terms/shard1 to Terms{values={core_node2=0, core_node4=0}, version=1}
   [junit4]   2> 30662 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 30662 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 30662 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44523/solr/tlog_replica_test_kill_leader_shard1_replica_t3/
   [junit4]   2> 30667 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_kill_leader_shard1_replica_t3 url=https://127.0.0.1:44523/solr START replicas=[https://127.0.0.1:38883/solr/tlog_replica_test_kill_leader_shard1_replica_t1/] nUpdates=100
   [junit4]   2> 30667 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_kill_leader_shard1_replica_t3 url=https://127.0.0.1:44523/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 30682 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=4
   [junit4]   2> 30690 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 30690 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 30690 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.ZkController tlog_replica_test_kill_leader_shard1_replica_t3 stopping background replication from leader
   [junit4]   2> 30695 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44523/solr/tlog_replica_test_kill_leader_shard1_replica_t3/ shard1
   [junit4]   2> 30797 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 30804 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_leader_shard1_replica_t3&action=CREATE&numShards=1&collection=tlog_replica_test_kill_leader&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1259
   [junit4]   2> 30901 INFO  (zkCallback-80-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_leader/state.json] for collection [tlog_replica_test_kill_leader] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 31671 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.ZkController tlog_replica_test_kill_leader_shard1_replica_t1 starting background replication from leader
   [junit4]   2> 31671 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 31680 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 31680 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 31784 INFO  (zkCallback-93-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_leader/state.json] for collection [tlog_replica_test_kill_leader] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 31784 INFO  (zkCallback-80-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_leader/state.json] for collection [tlog_replica_test_kill_leader] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 31859 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_leader_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_kill_leader&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2304
   [junit4]   2> 31865 INFO  (qtp681124768-280) [n:127.0.0.1:44523_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 31865 INFO  (qtp681124768-280) [n:127.0.0.1:44523_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_kill_leader&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2} status=0 QTime=2583
   [junit4]   2> 31904 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:44523/solr/tlog_replica_test_kill_leader_shard1_replica_t3/
   [junit4]   2> 31905 INFO  (qtp681124768-287) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_kill_leader/terms/shard1 to Terms{values={core_node2=1, core_node4=1}, version=2}
   [junit4]   2> 31918 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=7
   [junit4]   2> 31919 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 31920 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 31920 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 31920 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 31920 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 31924 INFO  (qtp205285192-286) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:44523/solr/tlog_replica_test_kill_leader_shard1_replica_t3/&wt=javabin&version=2}{add=[1 (1615298685491478528)]} 0 5
   [junit4]   2> 31926 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4653e574[tlog_replica_test_kill_leader_shard1_replica_t1] main]
   [junit4]   2> 31927 INFO  (searcherExecutor-176-thread-1) [    ] o.a.s.c.SolrCore [tlog_replica_test_kill_leader_shard1_replica_t1] Registered new searcher Searcher@4653e574[tlog_replica_test_kill_leader_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 31928 INFO  (qtp681124768-287) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1615298685491478528)]} 0 42
   [junit4]   2> 31939 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:44523/solr/tlog_replica_test_kill_leader_shard1_replica_t3/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 1
   [junit4]   2> 31944 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1615298685543907328,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 31944 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@239713bf commitCommandVersion:1615298685543907328
   [junit4]   2> 32199 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.s.SolrIndexSearcher Opening [Searcher@23ecd619[tlog_replica_test_kill_leader_shard1_replica_t3] main]
   [junit4]   2> 32200 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 32201 INFO  (searcherExecutor-175-thread-1-processing-n:127.0.0.1:44523_solr x:tlog_replica_test_kill_leader_shard1_replica_t3 c:tlog_replica_test_kill_leader s:shard1 r:core_node4) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.SolrCore [tlog_replica_test_kill_leader_shard1_replica_t3] Registered new searcher Searcher@23ecd619[tlog_replica_test_kill_leader_shard1_replica_t3] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
   [junit4]   2> 32202 INFO  (qtp681124768-278) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:44523/solr/tlog_replica_test_kill_leader_shard1_replica_t3/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 258
   [junit4]   2> 32204 INFO  (qtp681124768-280) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/update params={_stateVer_=tlog_replica_test_kill_leader:5&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 271
   [junit4]   2> 32217 INFO  (qtp681124768-280) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=3
   [junit4]   2> 32237 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 32339 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 32442 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 32545 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 32647 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 32749 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 32852 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 32955 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 33057 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 33160 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 33263 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 33287 INFO  (OverseerCollectionConfigSetProcessor-72156843297275908-127.0.0.1:44523_solr-n_0000000000) [n:127.0.0.1:44523_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 33365 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 33468 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 33572 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 33676 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 33779 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 33885 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 33987 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 34089 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 34192 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 34294 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 34397 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 34500 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 34603 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 34706 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 34809 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 34905 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 34906 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Master's generation: 2
   [junit4]   2> 34906 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Master's version: 1540468869728
   [junit4]   2> 34906 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 34906 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 34906 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Starting replication process
   [junit4]   2> 34912 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 34914 INFO  (qtp681124768-353) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&tlogFiles=false&wt=javabin&version=2&command=filelist} status=0 QTime=7
   [junit4]   2> 34915 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Number of files in latest index in master: 19
   [junit4]   2> 34917 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MockDirectoryWrapper(RAMDirectory@1eb463c0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@175dfd95)
   [junit4]   2> 34924 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=3
   [junit4]   2> 34937 INFO  (qtp681124768-353) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_FSTOrd50_0.doc&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 34946 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Direct_0.dvdd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 34952 INFO  (qtp681124768-353) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_FSTOrd50_0.pos&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 34955 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 34958 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 34961 INFO  (qtp681124768-353) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 34964 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Asserting_0.dvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 34968 INFO  (qtp681124768-353) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_FSTOrd50_0.tix&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 34973 INFO  (qtp681124768-353) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Asserting_0.pos&checksum=true&wt=filestream&command=filecontent} status=0 QTime=1
   [junit4]   2> 34986 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Asserting_0.doc&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 34989 INFO  (qtp681124768-353) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Asserting_0.tim&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 34993 INFO  (qtp681124768-353) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Asserting_0.dvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 34997 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Asserting_0.tip&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 35002 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_FSTOrd50_0.tbk&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 35006 INFO  (qtp681124768-353) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 35010 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Direct_0.dvdm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 35015 INFO  (qtp205285192-288) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 35020 INFO  (qtp681124768-353) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 35030 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 35037 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Bytes downloaded: 2903, Bytes skipped downloading: 0
   [junit4]   2> 35037 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=false,bytesDownloaded=2903) : 0 secs (null bytes/sec) to MockDirectoryWrapper(RAMDirectory@1eb463c0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@175dfd95)
   [junit4]   2> 35041 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 35042 INFO  (indexFetcher-186-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@370f4fea[tlog_replica_test_kill_leader_shard1_replica_t1] main]
   [junit4]   2> 35044 INFO  (searcherExecutor-176-thread-1) [    ] o.a.s.c.SolrCore [tlog_replica_test_kill_leader_shard1_replica_t1] Registered new searcher Searcher@370f4fea[tlog_replica_test_kill_leader_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
   [junit4]   2> 35118 INFO  (qtp205285192-277) [n:127.0.0.1:38883_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node2 x:tlog_replica_test_kill_leader_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
   [junit4]   2> 35129 INFO  (qtp681124768-281) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.S.Request [tlog_replica_test_kill_leader_shard1_replica_t3]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
   [junit4]   2> 35139 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.c.ChaosMonkey monkey: kill jetty! 44523
   [junit4]   2> 35173 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@fd0b6a{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 35174 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=748862728
   [junit4]   2> 35174 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 35175 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@24e46ba1: rootName = solr_44523, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@6d98b3f9
   [junit4]   2> 35183 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 35184 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1d6cf683: rootName = solr_44523, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5cd73f29
   [junit4]   2> 35189 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 35189 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1ad23fec: rootName = solr_44523, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5a6bddfe
   [junit4]   2> 35193 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:44523_solr
   [junit4]   2> 35195 INFO  (zkCallback-93-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 35195 INFO  (zkCallback-101-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 35195 INFO  (zkCallback-88-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 35195 INFO  (zkCallback-109-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 35195 INFO  (zkCallback-80-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 35196 INFO  (zkCallback-80-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_leader/state.json] for collection [tlog_replica_test_kill_leader] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 35197 INFO  (zkCallback-93-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_leader/state.json] for collection [tlog_replica_test_kill_leader] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 35199 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 35200 INFO  (coreCloseExecutor-188-thread-1) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.c.SolrCore [tlog_replica_test_kill_leader_shard1_replica_t3]  CLOSING SolrCore org.apache.solr.core.SolrCore@78c709be
   [junit4]   2> 35200 INFO  (coreCloseExecutor-188-thread-1) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_kill_leader.shard1.replica_t3, tag=78c709be
   [junit4]   2> 35200 INFO  (coreCloseExecutor-188-thread-1) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5cb756ab: rootName = solr_44523, domain = solr.core.tlog_replica_test_kill_leader.shard1.replica_t3, service url = null, agent id = null] for registry solr.core.tlog_replica_test_kill_leader.shard1.replica_t3 / com.codahale.metrics.MetricRegistry@702abfd5
   [junit4]   2> 35209 INFO  (coreCloseExecutor-188-thread-1) [n:127.0.0.1:44523_solr c:tlog_replica_test_kill_leader s:shard1 r:core_node4 x:tlog_replica_test_kill_leader_shard1_replica_t3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.tlog_replica_test_kill_leader.shard1.leader, tag=78c709be
   [junit4]   2> 35237 INFO  (TEST-TestTlogReplica.testKillLeader-seed#[8B7C26646A3CD05F]) [    ] o.a.s.c.Overseer Overseer (id=72156843297275908-127.0.0.1:44523_solr-n_0000000000) closing
   [junit4]   2> 35237 INFO  (OverseerStateUpdate-72156843297275908-127.0.0.1:44523_solr-n_0000000000) [n:127.0.0.1:44523_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44523_solr
   [junit4]   2> 35238 WARN  (OverseerAutoScalingTriggerThread-72156843297275908-127.0.0.1:44523_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 35241 INFO  (zkCallback-93-thread-2) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38883_solr
   [junit4]   2> 35242 INFO

[...truncated too long message...]

4-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@18899145{/solr,null,UNAVAILABLE}
   [junit4]   2> 200196 INFO  (jetty-closer-134-thread-2) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 200197 INFO  (jetty-closer-134-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 200197 INFO  (jetty-closer-134-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5a10132e: rootName = solr_43401, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@119b1ae7
   [junit4]   2> 200197 INFO  (jetty-closer-134-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:43401_solr
   [junit4]   2> 200198 INFO  (jetty-closer-134-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 200198 INFO  (zkCallback-218-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 200198 INFO  (zkCallback-225-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 200199 INFO  (jetty-closer-134-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72157050582925333-127.0.0.1:43401_solr-n_0000000004) closing
   [junit4]   2> 200199 INFO  (OverseerStateUpdate-72157050582925333-127.0.0.1:43401_solr-n_0000000004) [n:127.0.0.1:43401_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43401_solr
   [junit4]   2> 200199 WARN  (OverseerAutoScalingTriggerThread-72157050582925333-127.0.0.1:43401_solr-n_0000000004) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 200201 INFO  (jetty-closer-134-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4ed4f555{/solr,null,UNAVAILABLE}
   [junit4]   2> 200201 INFO  (jetty-closer-134-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 200201 ERROR (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 200201 INFO  (SUITE-TestTlogReplica-seed#[8B7C26646A3CD05F]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45343 45343
   [junit4]   2> 200311 INFO  (Thread-99) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45343 45343
   [junit4]   2> 200312 WARN  (Thread-99) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	33	/solr/collections/tlog_replica_test_create_delete/terms/shard1
   [junit4]   2> 	30	/solr/configs/conf
   [junit4]   2> 	28	/solr/collections/tlog_replica_test_create_delete/terms/shard2
   [junit4]   2> 	20	/solr/collections/tlog_replica_test_remove_leader/terms/shard1
   [junit4]   2> 	18	/solr/collections/tlog_replica_test_recovery/terms/shard1
   [junit4]   2> 	17	/solr/collections/tlog_replica_test_basic_leader_election/terms/shard1
   [junit4]   2> 	16	/solr/collections/tlog_replica_test_kill_leader/terms/shard1
   [junit4]   2> 	16	/solr/collections/tlog_replica_test_kill_tlog_replica/terms/shard1
   [junit4]   2> 	15	/solr/aliases.json
   [junit4]   2> 	11	/solr/collections/tlog_replica_test_only_leader_indexes/terms/shard1
   [junit4]   2> 	10	/solr/collections/tlog_replica_test_delete_by_id/terms/shard1
   [junit4]   2> 	9	/solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/terms/shard1
   [junit4]   2> 	7	/solr/security.json
   [junit4]   2> 	6	/solr/collections/tlog_replica_test_add_remove_tlog_replica/terms/shard2
   [junit4]   2> 	5	/solr/collections/tlog_replica_test_add_remove_tlog_replica/terms/shard1
   [junit4]   2> 	4	/solr/collections/tlog_replica_test_add_docs/terms/shard1
   [junit4]   2> 	4	/solr/collections/tlog_replica_test_real_time_get/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	20	/solr/collections/tlog_replica_test_create_delete/state.json
   [junit4]   2> 	15	/solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json
   [junit4]   2> 	15	/solr/clusterprops.json
   [junit4]   2> 	15	/solr/clusterstate.json
   [junit4]   2> 	14	/solr/collections/tlog_replica_test_kill_leader/state.json
   [junit4]   2> 	10	/solr/collections/tlog_replica_test_kill_tlog_replica/state.json
   [junit4]   2> 	9	/solr/collections/tlog_replica_test_remove_leader/state.json
   [junit4]   2> 	8	/solr/collections/tlog_replica_test_recovery/state.json
   [junit4]   2> 	8	/solr/collections/tlog_replica_test_basic_leader_election/state.json
   [junit4]   2> 	3	/solr/overseer_elect/election/72157050582925316-127.0.0.1:43401_solr-n_0000000000
   [junit4]   2> 	3	/solr/autoscaling.json
   [junit4]   2> 	3	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/72157050582925316-core_node16-n_0000000001
   [junit4]   2> 	3	/solr/collections/tlog_replica_test_add_remove_tlog_replica/state.json
   [junit4]   2> 	3	/solr/collections/tlog_replica_test_only_leader_indexes/state.json
   [junit4]   2> 	3	/solr/collections/tlog_replica_test_delete_by_id/state.json
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/72157050582925325-core_node15-n_0000000000
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/72157050582925316-core_node9-n_0000000001
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_add_docs/state.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72157050582925333-127.0.0.1:43401_solr-n_0000000004
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/72157050582925325-core_node7-n_0000000001
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_kill_tlog_replica/leader_elect/shard1/election/72157050582925329-core_node4-n_0000000000
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_real_time_get/state.json
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_recovery/leader_elect/shard1/election/72157050582925316-core_node3-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	15	/solr/live_nodes
   [junit4]   2> 	15	/solr/collections
   [junit4]   2> 	3	/solr/overseer/queue
   [junit4]   2> 	3	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	3	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	3	/solr/overseer/queue-work
   [junit4]   2> 	3	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_8B7C26646A3CD05F-002
   [junit4]   2> Oct 25, 2018 12:55:22 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): {foo=FSTOrd50, title_s=FSTOrd50, id=PostingsFormat(name=Asserting), foo_s=FSTOrd50}, docValues:{_version_=DocValuesFormat(name=Asserting), id=DocValuesFormat(name=Direct), inplace_updatable_int=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=735, maxMBSortInHeap=5.889689477991673, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@78610439), locale=nn, timezone=Pacific/Apia
   [junit4]   2> NOTE: Linux 4.15.0-36-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=209855640,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestTlogReplica, TestTlogReplica]
   [junit4] Completed [5/5 (5!)] on J2 in 93.73s, 13 tests, 1 failure <<< FAILURES!

[...truncated 15 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 5 suites, 65 tests, 5 failures [seed: 8B7C26646A3CD05F]

Total time: 3 minutes 23 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.cloud.TestTlogReplica
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=26e14986af7aa60b72940f611f63b2a50fbb9980, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23090
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_172) - Build # 23090 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23090/
Java: 32bit/jdk1.8.0_172 -server -XX:+UseParallelGC

6 tests failed.
FAILED:  org.apache.solr.client.solrj.impl.CloudSolrClientTest.testRouting

Error Message:
Error from server at https://127.0.0.1:37733/solr/collection1_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n3/update</title> </head> <body><h2>HTTP ERROR 404</h2> <p>Problem accessing /solr/collection1_shard2_replica_n3/update. Reason: <pre>    Can not find: /solr/collection1_shard2_replica_n3/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>  </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:37733/solr/collection1_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n3/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n3/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n3/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

	at __randomizedtesting.SeedInfo.seed([E333E75639CBE865:2184DB3E3A8B181D]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:551)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1016)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:237)
	at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testRouting(CloudSolrClientTest.java:269)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37733/solr/collection1_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n3/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n3/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n3/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:528)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more


FAILED:  org.apache.solr.client.solrj.impl.CloudSolrClientTest.testVersionsAreReturned

Error Message:
Error from server at https://127.0.0.1:37733/solr/collection1_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n3/update</title> </head> <body><h2>HTTP ERROR 404</h2> <p>Problem accessing /solr/collection1_shard2_replica_n3/update. Reason: <pre>    Can not find: /solr/collection1_shard2_replica_n3/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>  </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:37733/solr/collection1_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n3/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n3/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n3/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

	at __randomizedtesting.SeedInfo.seed([E333E75639CBE865:1BF51E63AAD270AD]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:551)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1016)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:237)
	at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testVersionsAreReturned(CloudSolrClientTest.java:725)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37733/solr/collection1_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n3/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n3/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n3/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:528)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([919B75986D291620]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([919B75986D291620]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([919B75986D291620]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([919B75986D291620]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 15093 lines...]
   [junit4] Suite: org.apache.solr.search.QueryEqualityTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.search.QueryEqualityTest_919B75986D291620-001/init-core-data-001
   [junit4]   2> 2749580 WARN  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 2749580 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2749582 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2749582 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2749582 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 2749583 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2749632 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2749692 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 2749740 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2750106 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2750106 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2750116 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16dfd37
   [junit4]   2> 2750116 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16dfd37
   [junit4]   2> 2750116 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16dfd37
   [junit4]   2> 2750117 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2750146 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2750171 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 2750211 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2750215 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 2750215 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16dfd37
   [junit4]   2> 2750215 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.search.QueryEqualityTest_919B75986D291620-001/init-core-data-001/]
   [junit4]   2> 2750216 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=38.119140625, floorSegmentMB=1.6767578125, forceMergeDeletesPctAllowed=15.47257861344161, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=28.267313431956765
   [junit4]   2> 2750243 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2750243 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2750244 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2750244 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2750244 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=715716484, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 2750245 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@51ab3f[collection1] main]
   [junit4]   2> 2750245 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 2750308 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 2750548 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2750548 INFO  (searcherExecutor-9560-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 2750548 INFO  (coreLoadExecutor-9559-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1615286465821933568
   [junit4]   2> 2750548 INFO  (searcherExecutor-9560-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 2750548 INFO  (searcherExecutor-9560-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 2750548 INFO  (searcherExecutor-9560-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 2750548 INFO  (searcherExecutor-9560-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 2750549 INFO  (searcherExecutor-9560-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 2750549 INFO  (searcherExecutor-9560-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 2750549 INFO  (searcherExecutor-9560-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 2750549 INFO  (searcherExecutor-9560-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 2750550 INFO  (searcherExecutor-9560-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@51ab3f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2750551 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 2750553 INFO  (TEST-QueryEqualityTest.testBoolQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBoolQuery
   [junit4]   2> 2750555 INFO  (TEST-QueryEqualityTest.testBoolQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBoolQuery
   [junit4]   2> 2750557 INFO  (TEST-QueryEqualityTest.testTestFuncs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTestFuncs
   [junit4]   2> 2750559 INFO  (TEST-QueryEqualityTest.testTestFuncs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTestFuncs
   [junit4]   2> 2750562 INFO  (TEST-QueryEqualityTest.testAggs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAggs
   [junit4]   2> 2750567 INFO  (TEST-QueryEqualityTest.testAggs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testAggs
   [junit4]   2> 2750569 INFO  (TEST-QueryEqualityTest.testFuncTestfunc-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncTestfunc
   [junit4]   2> 2750570 INFO  (TEST-QueryEqualityTest.testFuncTestfunc-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncTestfunc
   [junit4]   2> 2750572 INFO  (TEST-QueryEqualityTest.testQuerySimple-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQuerySimple
   [junit4]   2> 2750574 INFO  (TEST-QueryEqualityTest.testQuerySimple-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQuerySimple
   [junit4]   2> 2750577 INFO  (TEST-QueryEqualityTest.testFuncIf-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncIf
   [junit4]   2> 2750580 INFO  (TEST-QueryEqualityTest.testFuncIf-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncIf
   [junit4]   2> 2750582 INFO  (TEST-QueryEqualityTest.testFuncStrdist-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncStrdist
   [junit4]   2> 2750586 INFO  (TEST-QueryEqualityTest.testFuncStrdist-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncStrdist
   [junit4]   2> 2750589 INFO  (TEST-QueryEqualityTest.testQueryScoreJoin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryScoreJoin
   [junit4]   2> 2750590 INFO  (TEST-QueryEqualityTest.testQueryScoreJoin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryScoreJoin
   [junit4]   2> 2750593 INFO  (TEST-QueryEqualityTest.testQueryFrange-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryFrange
   [junit4]   2> 2750594 INFO  (TEST-QueryEqualityTest.testQueryFrange-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryFrange
   [junit4]   2> 2750597 INFO  (TEST-QueryEqualityTest.testFuncRelatedness-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncRelatedness
   [junit4]   2> 2750597 INFO  (TEST-QueryEqualityTest.testFuncRelatedness-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncRelatedness
   [junit4]   2> 2750600 INFO  (TEST-QueryEqualityTest.testTerms-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTerms
   [junit4]   2> 2750601 INFO  (TEST-QueryEqualityTest.testTerms-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTerms
   [junit4]   2> 2750604 INFO  (TEST-QueryEqualityTest.testFuncNorm-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncNorm
   [junit4]   2> 2750606 INFO  (TEST-QueryEqualityTest.testFuncNorm-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncNorm
   [junit4]   2> 2750608 INFO  (TEST-QueryEqualityTest.testQueryJoin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryJoin
   [junit4]   2> 2750609 INFO  (TEST-QueryEqualityTest.testQueryJoin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryJoin
   [junit4]   2> 2750612 INFO  (TEST-QueryEqualityTest.testFuncDoubleValueMathFuncs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDoubleValueMathFuncs
   [junit4]   2> 2750613 INFO  (TEST-QueryEqualityTest.testFuncDoubleValueMathFuncs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDoubleValueMathFuncs
   [junit4]   2> 2750616 INFO  (TEST-QueryEqualityTest.testFuncConcat-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncConcat
   [junit4]   2> 2750622 INFO  (TEST-QueryEqualityTest.testFuncConcat-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncConcat
   [junit4]   2> 2750625 INFO  (TEST-QueryEqualityTest.testFuncCscore-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncCscore
   [junit4]   2> 2750626 INFO  (TEST-QueryEqualityTest.testFuncCscore-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncCscore
   [junit4]   2> 2750629 INFO  (TEST-QueryEqualityTest.testLocalParamsWithRepeatingParam-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLocalParamsWithRepeatingParam
   [junit4]   2> 2750631 INFO  (TEST-QueryEqualityTest.testLocalParamsWithRepeatingParam-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testLocalParamsWithRepeatingParam
   [junit4]   2> 2750634 INFO  (TEST-QueryEqualityTest.testFuncExists-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncExists
   [junit4]   2> 2750634 INFO  (TEST-QueryEqualityTest.testFuncExists-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncExists
   [junit4]   2> 2750637 INFO  (TEST-QueryEqualityTest.testPayloadFunction-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testPayloadFunction
   [junit4]   2> 2750639 INFO  (TEST-QueryEqualityTest.testPayloadFunction-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testPayloadFunction
   [junit4]   2> 2750641 INFO  (TEST-QueryEqualityTest.testHash-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testHash
   [junit4]   2> 2750642 INFO  (TEST-QueryEqualityTest.testHash-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testHash
   [junit4]   2> 2750645 INFO  (TEST-QueryEqualityTest.testFuncDef-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDef
   [junit4]   2> 2750645 INFO  (TEST-QueryEqualityTest.testFuncDef-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDef
   [junit4]   2> 2750648 INFO  (TEST-QueryEqualityTest.testQueryMaxScore-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryMaxScore
   [junit4]   2> 2750650 INFO  (TEST-QueryEqualityTest.testQueryMaxScore-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryMaxScore
   [junit4]   2> 2750653 INFO  (TEST-QueryEqualityTest.testFuncNumdocs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncNumdocs
   [junit4]   2> 2750654 INFO  (TEST-QueryEqualityTest.testFuncNumdocs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncNumdocs
   [junit4]   2> 2750657 INFO  (TEST-QueryEqualityTest.testFuncSingleValueMathFuncs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncSingleValueMathFuncs
   [junit4]   2> 2750659 INFO  (TEST-QueryEqualityTest.testFuncSingleValueMathFuncs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncSingleValueMathFuncs
   [junit4]   2> 2750662 INFO  (TEST-QueryEqualityTest.testGraphTermsQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testGraphTermsQuery
   [junit4]   2> 2750663 INFO  (TEST-QueryEqualityTest.testGraphTermsQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testGraphTermsQuery
   [junit4]   2> 2750666 INFO  (TEST-QueryEqualityTest.testFuncMin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMin
   [junit4]   2> 2750667 INFO  (TEST-QueryEqualityTest.testFuncMin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMin
   [junit4]   2> 2750672 INFO  (TEST-QueryEqualityTest.testFuncScale-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncScale
   [junit4]   2> 2750672 INFO  (TEST-QueryEqualityTest.testFuncScale-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncScale
   [junit4]   2> 2750676 INFO  (TEST-QueryEqualityTest.testFuncNot-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncNot
   [junit4]   2> 2750677 INFO  (TEST-QueryEqualityTest.testFuncNot-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncNot
   [junit4]   2> 2750691 INFO  (TEST-QueryEqualityTest.testSignificantTermsQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSignificantTermsQuery
   [junit4]   2> 2750692 INFO  (TEST-QueryEqualityTest.testSignificantTermsQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testSignificantTermsQuery
   [junit4]   2> 2750706 INFO  (TEST-QueryEqualityTest.testFuncSub-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncSub
   [junit4]   2> 2750707 INFO  (TEST-QueryEqualityTest.testFuncSub-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncSub
   [junit4]   2> 2750721 INFO  (TEST-QueryEqualityTest.testFuncField-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncField
   [junit4]   2> 2750722 INFO  (TEST-QueryEqualityTest.testFuncField-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncField
   [junit4]   2> 2750726 INFO  (TEST-QueryEqualityTest.testFuncProduct-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncProduct
   [junit4]   2> 2750726 INFO  (TEST-QueryEqualityTest.testFuncProduct-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncProduct
   [junit4]   2> 2750737 INFO  (TEST-QueryEqualityTest.testFuncBools-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncBools
   [junit4]   2> 2750738 INFO  (TEST-QueryEqualityTest.testFuncBools-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncBools
   [junit4]   2> 2750749 INFO  (TEST-QueryEqualityTest.testQuerySwitch-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQuerySwitch
   [junit4]   2> 2750749 INFO  (TEST-QueryEqualityTest.testQuerySwitch-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQuerySwitch
   [junit4]   2> 2750752 INFO  (TEST-QueryEqualityTest.testPayloadCheckQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testPayloadCheckQuery
   [junit4]   2> 2750753 INFO  (TEST-QueryEqualityTest.testPayloadCheckQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testPayloadCheckQuery
   [junit4]   2> 2750755 INFO  (TEST-QueryEqualityTest.testGraphQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testGraphQuery
   [junit4]   2> 2750756 INFO  (TEST-QueryEqualityTest.testGraphQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testGraphQuery
   [junit4]   2> 2750759 INFO  (TEST-QueryEqualityTest.testQueryBbox-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryBbox
   [junit4]   2> 2750763 INFO  (TEST-QueryEqualityTest.testQueryBbox-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryBbox
   [junit4]   2> 2750765 INFO  (TEST-QueryEqualityTest.testQueryComplexPhrase-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryComplexPhrase
   [junit4]   2> 2750771 INFO  (TEST-QueryEqualityTest.testQueryComplexPhrase-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryComplexPhrase
   [junit4]   2> 2750774 INFO  (TEST-QueryEqualityTest.testFuncRecip-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncRecip
   [junit4]   2> 2750774 INFO  (TEST-QueryEqualityTest.testFuncRecip-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncRecip
   [junit4]   2> 2750777 INFO  (TEST-QueryEqualityTest.testFuncGhhsin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncGhhsin
   [junit4]   2> 2750777 INFO  (TEST-QueryEqualityTest.testFuncGhhsin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncGhhsin
   [junit4]   2> 2750780 INFO  (TEST-QueryEqualityTest.testFuncLiteral-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncLiteral
   [junit4]   2> 2750780 INFO  (TEST-QueryEqualityTest.testFuncLiteral-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncLiteral
   [junit4]   2> 2750783 INFO  (TEST-QueryEqualityTest.testFuncSttf-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncSttf
   [junit4]   2> 2750784 INFO  (TEST-QueryEqualityTest.testFuncSttf-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncSttf
   [junit4]   2> 2750786 INFO  (TEST-QueryEqualityTest.testQueryTerm-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryTerm
   [junit4]   2> 2750787 INFO  (TEST-QueryEqualityTest.testQueryTerm-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryTerm
   [junit4]   2> 2750789 INFO  (TEST-QueryEqualityTest.testFuncJoindf-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncJoindf
   [junit4]   2> 2750791 INFO  (TEST-QueryEqualityTest.testFuncJoindf-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncJoindf
   [junit4]   2> 2750794 INFO  (TEST-QueryEqualityTest.testQuerySurround-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQuerySurround
   [junit4]   2> 2750797 INFO  (TEST-QueryEqualityTest.testQuerySurround-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQuerySurround
   [junit4]   2> 2750800 INFO  (TEST-QueryEqualityTest.testFuncGeodist-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncGeodist
   [junit4]   2> 2750801 INFO  (TEST-QueryEqualityTest.testFuncGeodist-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncGeodist
   [junit4]   2> 2750804 INFO  (TEST-QueryEqualityTest.testFuncMax-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMax
   [junit4]   2> 2750805 INFO  (TEST-QueryEqualityTest.testFuncMax-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMax
   [junit4]   2> 2750809 INFO  (TEST-QueryEqualityTest.testFuncTop-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncTop
   [junit4]   2> 2750809 INFO  (TEST-QueryEqualityTest.testFuncTop-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncTop
   [junit4]   2> 2750812 INFO  (TEST-QueryEqualityTest.testParserCoverage-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testParserCoverage
   [junit4]   2> 2750813 INFO  (TEST-QueryEqualityTest.testParserCoverage-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testParserCoverage
   [junit4]   2> 2750819 INFO  (TEST-QueryEqualityTest.testCompares-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCompares
   [junit4]   2> 2750832 INFO  (TEST-QueryEqualityTest.testCompares-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCompares
   [junit4]   2> 2750837 INFO  (TEST-QueryEqualityTest.testChildField-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testChildField
   [junit4]   2> 2750840 INFO  (TEST-QueryEqualityTest.testChildField-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testChildField
   [junit4]   2> 2750843 INFO  (TEST-QueryEqualityTest.testTlogitQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTlogitQuery
   [junit4]   2> 2750844 INFO  (TEST-QueryEqualityTest.testTlogitQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTlogitQuery
   [junit4]   2> 2750847 INFO  (TEST-QueryEqualityTest.testFuncMathConsts-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMathConsts
   [junit4]   2> 2750847 INFO  (TEST-QueryEqualityTest.testFuncMathConsts-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMathConsts
   [junit4]   2> 2750850 INFO  (TEST-QueryEqualityTest.testReRankQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testReRankQuery
   [junit4]   2> 2750851 INFO  (TEST-QueryEqualityTest.testReRankQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testReRankQuery
   [junit4]   2> 2750854 INFO  (TEST-QueryEqualityTest.testQueryDismax-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryDismax
   [junit4]   2> 2750857 INFO  (TEST-QueryEqualityTest.testQueryDismax-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryDismax
   [junit4]   2> 2750860 INFO  (TEST-QueryEqualityTest.testFuncDiv-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDiv
   [junit4]   2> 2750861 INFO  (TEST-QueryEqualityTest.testFuncDiv-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDiv
   [junit4]   2> 2750864 INFO  (TEST-QueryEqualityTest.testField-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testField
   [junit4]   2> 2750865 INFO  (TEST-QueryEqualityTest.testField-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testField
   [junit4]   2> 2750868 INFO  (TEST-QueryEqualityTest.testFuncCurrency-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncCurrency
   [junit4]   2> 2750869 INFO  (TEST-QueryEqualityTest.testFuncCurrency-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncCurrency
   [junit4]   2> 2750877 INFO  (TEST-QueryEqualityTest.testFuncRord-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncRord
   [junit4]   2> 2750878 INFO  (TEST-QueryEqualityTest.testFuncRord-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncRord
   [junit4]   2> 2750881 INFO  (TEST-QueryEqualityTest.testIGainQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testIGainQuery
   [junit4]   2> 2750881 INFO  (TEST-QueryEqualityTest.testIGainQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testIGainQuery
   [junit4]   2> 2750884 INFO  (TEST-QueryEqualityTest.testFuncOrd-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncOrd
   [junit4]   2> 2750885 INFO  (TEST-QueryEqualityTest.testFuncOrd-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncOrd
   [junit4]   2> 2750888 INFO  (TEST-QueryEqualityTest.testFuncQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncQuery
   [junit4]   2> 2750888 INFO  (TEST-QueryEqualityTest.testFuncQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncQuery
   [junit4]   2> 2750891 INFO  (TEST-QueryEqualityTest.testFuncTerms-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncTerms
   [junit4]   2> 2750897 INFO  (TEST-QueryEqualityTest.testFuncTerms-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncTerms
   [junit4]   2> 2750900 INFO  (TEST-QueryEqualityTest.testPayloadScoreQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testPayloadScoreQuery
   [junit4]   2> 2750901 INFO  (TEST-QueryEqualityTest.testPayloadScoreQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testPayloadScoreQuery
   [junit4]   2> 2750903 INFO  (TEST-QueryEqualityTest.testFuncLinear-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncLinear
   [junit4]   2> 2750905 INFO  (TEST-QueryEqualityTest.testFuncLinear-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncLinear
   [junit4]   2> 2750908 INFO  (TEST-QueryEqualityTest.testExportQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testExportQuery
   [junit4]   2> 2750909 INFO  (TEST-QueryEqualityTest.testExportQuery-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testExportQuery
   [junit4]   2> 2750911 INFO  (TEST-QueryEqualityTest.testFuncSqedist-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncSqedist
   [junit4]   2> 2750912 INFO  (TEST-QueryEqualityTest.testFuncSqedist-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncSqedist
   [junit4]   2> 2750914 INFO  (TEST-QueryEqualityTest.testFilters-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFilters
   [junit4]   2> 2750915 INFO  (TEST-QueryEqualityTest.testFilters-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFilters
   [junit4]   2> 2750918 INFO  (TEST-QueryEqualityTest.testQueryCollapse-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryCollapse
   [junit4]   2> 2750919 INFO  (TEST-QueryEqualityTest.testQueryCollapse-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryCollapse
   [junit4]   2> 2750922 INFO  (TEST-QueryEqualityTest.testFuncMaxdoc-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMaxdoc
   [junit4]   2> 2750922 INFO  (TEST-QueryEqualityTest.testFuncMaxdoc-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMaxdoc
   [junit4]   2> 2750925 INFO  (TEST-QueryEqualityTest.testFuncBoost-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncBoost
   [junit4]   2> 2750928 INFO  (TEST-QueryEqualityTest.testFuncBoost-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncBoost
   [junit4]   2> 2750931 INFO  (TEST-QueryEqualityTest.testFuncSum-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncSum
   [junit4]   2> 2750932 INFO  (TEST-QueryEqualityTest.testFuncSum-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncSum
   [junit4]   2> 2750935 INFO  (TEST-QueryEqualityTest.testQueryFunc-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryFunc
   [junit4]   2> 2750935 INFO  (TEST-QueryEqualityTest.testQueryFunc-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryFunc
   [junit4]   2> 2750942 INFO  (TEST-QueryEqualityTest.testFuncHsin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncHsin
   [junit4]   2> 2750944 INFO  (TEST-QueryEqualityTest.testFuncHsin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncHsin
   [junit4]   2> 2750947 INFO  (TEST-QueryEqualityTest.testFuncVector-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncVector
   [junit4]   2> 2750947 INFO  (TEST-QueryEqualityTest.testFuncVector-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncVector
   [junit4]   2> 2750950 INFO  (TEST-QueryEqualityTest.testQueryRaw-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryRaw
   [junit4]   2> 2750950 INFO  (TEST-QueryEqualityTest.testQueryRaw-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryRaw
   [junit4]   2> 2750953 INFO  (TEST-QueryEqualityTest.testFuncMap-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMap
   [junit4]   2> 2750953 INFO  (TEST-QueryEqualityTest.testFuncMap-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMap
   [junit4]   2> 2750956 INFO  (TEST-QueryEqualityTest.testFuncDoubleValueBools-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDoubleValueBools
   [junit4]   2> 2750957 INFO  (TEST-QueryEqualityTest.testFuncDoubleValueBools-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDoubleValueBools
   [junit4]   2> 2750960 INFO  (TEST-QueryEqualityTest.testFuncMs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMs
   [junit4]   2> 2750961 INFO  (TEST-QueryEqualityTest.testFuncMs-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMs
   [junit4]   2> 2750964 INFO  (TEST-QueryEqualityTest.testQueryNested-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryNested
   [junit4]   2> 2750965 INFO  (TEST-QueryEqualityTest.testQueryNested-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryNested
   [junit4]   2> 2750968 INFO  (TEST-QueryEqualityTest.testFuncDist-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDist
   [junit4]   2> 2750968 INFO  (TEST-QueryEqualityTest.testFuncDist-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDist
   [junit4]   2> 2750971 INFO  (TEST-QueryEqualityTest.testBlockJoin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBlockJoin
   [junit4]   2> 2750972 INFO  (TEST-QueryEqualityTest.testBlockJoin-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBlockJoin
   [junit4]   2> 2750975 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryMLT
   [junit4]   2> 2750976 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1 (1615286466269675520)]} 0 1
   [junit4]   2> 2750979 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1615286466273869824,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2750979 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@aaf876 commitCommandVersion:1615286466273869824
   [junit4]   2> 2750981 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@241415[collection1] main]
   [junit4]   2> 2750982 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2750983 INFO  (searcherExecutor-9560-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@241415[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
   [junit4]   2> 2750983 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 2750985 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1615286466280161280,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2750985 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 2750985 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2750985 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 0
   [junit4]   2> 2750986 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryMLT
   [junit4]   2> 2750989 INFO  (TEST-QueryEqualityTest.testQueryPrefix-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryPrefix
   [junit4]   2> 2750989 INFO  (TEST-QueryEqualityTest.testQueryPrefix-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryPrefix
   [junit4]   2> 2750992 INFO  (TEST-QueryEqualityTest.testQueryLucene-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryLucene
   [junit4]   2> 2750993 INFO  (TEST-QueryEqualityTest.testQueryLucene-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryLucene
   [junit4]   2> 2750996 INFO  (TEST-QueryEqualityTest.testDateMathParsingEquality-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDateMathParsingEquality
   [junit4]   2> 2750997 INFO  (TEST-QueryEqualityTest.testDateMathParsingEquality-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDateMathParsingEquality
   [junit4]   2> 2751000 INFO  (TEST-QueryEqualityTest.testFuncGeohash-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncGeohash
   [junit4]   2> 2751002 INFO  (TEST-QueryEqualityTest.testFuncGeohash-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncGeohash
   [junit4]   2> 2751005 INFO  (TEST-QueryEqualityTest.testQueryGeofilt-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryGeofilt
   [junit4]   2> 2751005 INFO  (TEST-QueryEqualityTest.testQueryGeofilt-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryGeofilt
   [junit4]   2> 2751008 INFO  (TEST-QueryEqualityTest.testQueryBoost-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryBoost
   [junit4]   2> 2751009 INFO  (TEST-QueryEqualityTest.testQueryBoost-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryBoost
   [junit4]   2> 2751012 INFO  (TEST-QueryEqualityTest.testFuncMod-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMod
   [junit4]   2> 2751013 INFO  (TEST-QueryEqualityTest.testFuncMod-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMod
   [junit4]   2> 2751016 INFO  (TEST-QueryEqualityTest.testMatchAllDocsQueryXmlParser-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMatchAllDocsQueryXmlParser
   [junit4]   2> 2751038 INFO  (TEST-QueryEqualityTest.testMatchAllDocsQueryXmlParser-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMatchAllDocsQueryXmlParser
   [junit4]   2> 2751039 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 2751039 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=4120962
   [junit4]   2> 2751039 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2751039 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@385618: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@143117e
   [junit4]   2> 2751044 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2751044 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3800d9: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@d6efef
   [junit4]   2> 2751044 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2751044 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1cc71a4: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1d2463a
   [junit4]   2> 2751045 INFO  (coreCloseExecutor-9565-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@12469f4
   [junit4]   2> 2751045 INFO  (coreCloseExecutor-9565-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=12469f4
   [junit4]   2> 2751045 INFO  (coreCloseExecutor-9565-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@fa863b: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@d3ca77
   [junit4]   2> 2751058 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): {lowerfilt=PostingsFormat(name=Direct), id=FST50}, docValues:{_version_=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=560, maxMBSortInHeap=7.529748729025693, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@101cb0b), locale=cs-CZ, timezone=America/Catamarca
   [junit4]   2> NOTE: Linux 4.15.0-36-generic i386/Oracle Corporation 1.8.0_172 (32-bit)/cpus=8,threads=1,free=247007672,total=460849152
   [junit4]   2> NOTE: All tests run in this JVM: [TestReqParamsAPI, PeerSyncWithBufferUpdatesTest, TestSkipOverseerOperations, RuleEngineTest, LeaderElectionContextKeyTest, CollectionsAPIDistributedZkTest, HttpSolrCallGetCoreTest, DistributedUpdateProcessorTest, TestCloudJSONFacetJoinDomain, TestSolrXml, TestStressRecovery, TestReload, TestApiFramework, TestJsonFacets, TestUnInvertedFieldException, OverseerRolesTest, HealthCheckHandlerTest, TestRebalanceLeaders, TestStressVersions, SuggestComponentContextFilterQueryTest, TestInfoStreamLogging, XmlUpdateRequestHandlerTest, TestTrackingShardHandlerFactory, ClassificationUpdateProcessorTest, DocumentBuilderTest, HighlighterTest, CheckHdfsIndexTest, TestCloudPseudoReturnFields, VersionInfoTest, DistributedExpandComponentTest, MinimalSchemaTest, MigrateRouteKeyTest, TestMultiValuedNumericRangeQuery, CurrencyFieldTypeTest, SolrInfoBeanTest, TestAnalyzeInfixSuggestions, TestPullReplicaErrorHandling, CurrencyRangeFacetCloudTest, TestLazyCores, DocumentAnalysisRequestHandlerTest, LeaderFailoverAfterPartitionTest, PolyFieldTest, HdfsCollectionsAPIDistributedZkTest, ShufflingReplicaListTransformerTest, TestRandomFaceting, SolrCoreCheckLockOnStartupTest, TestExactStatsCache, SubstringBytesRefFilterTest, TestCloudManagedSchema, TestChildDocTransformer, DocValuesMissingTest, TestSolrCloudWithSecureImpersonation, TestConfigOverlay, CdcrVersionReplicationTest, TestLRUCache, EnumFieldTest, TestManagedSynonymGraphFilterFactory, TestQuerySenderListener, TestLegacyFieldReuse, NodeLostTriggerIntegrationTest, CdcrUpdateLogTest, SolrIndexConfigTest, TestMacros, TestExpandComponent, CoreAdminOperationTest, SolrRrdBackendFactoryTest, DistributedQueryComponentOptimizationTest, TestDefaultStatsCache, TestSort, UnloadDistributedZkTest, AutoscalingHistoryHandlerTest, TestRealTimeGet, MoveReplicaHDFSTest, RecoveryZkTest, UUIDUpdateProcessorFallbackTest, BasicFunctionalityTest, TestDistributedSearch, TestTolerantUpdateProcessorRandomCloud, CdcrOpsAndBoundariesTest, TestNumericTokenStream, TestSchemaSimilarityResource, ConfigureRecoveryStrategyTest, TestCollapseQParserPlugin, TestSolrFieldCacheBean, SliceStateTest, TestBM25SimilarityFactory, TestSolrCLIRunExample, ZkShardTermsTest, MultiThreadedOCPTest, SolrSlf4jReporterTest, CircularListTest, TestPKIAuthenticationPlugin, TestSortableTextField, PrimitiveFieldTypeTest, HdfsLockFactoryTest, DistribJoinFromCollectionTest, HdfsThreadLeakTest, TestManagedResourceStorage, TestSolr4Spatial, TestObjectReleaseTracker, DistributedFacetPivotWhiteBoxTest, RestoreTriggerStateTest, TestFieldSortValues, AtomicUpdatesTest, AutoAddReplicasIntegrationTest, HttpTriggerListenerTest, DistributedSuggestComponentTest, TestPayloadScoreQParserPlugin, DistributedFacetPivotLongTailTest, LeaderVoteWaitTimeoutTest, TestLeaderElectionZkExpiry, BasicAuthStandaloneTest, TestBadConfig, TestSystemCollAutoCreate, TestReversedWildcardFilterFactory, ScheduledTriggerTest, SystemLogListenerTest, TaggerTest, PropertiesRequestHandlerTest, TestOrdValues, ProtectedTermFilterFactoryTest, ConfigSetsAPITest, SolrGraphiteReporterTest, BJQParserTest, RankQueryTest, DistributedFacetSimpleRefinementLongTailTest, TestMinHashQParser, BasicDistributedZkTest, SignatureUpdateProcessorFactoryTest, TestValueSourceCache, TestEmbeddedSolrServerSchemaAPI, TestFileDictionaryLookup, TestDynamicLoading, ChaosMonkeyNothingIsSafeWithPullReplicasTest, HdfsRecoveryZkTest, OverseerTest, TestLuceneIndexBackCompat, TestConfigSetsAPI, TestMiniSolrCloudClusterSSL, TestShortCircuitedRequests, TestStressInPlaceUpdates, TestStressLiveNodes, TestWithCollection, ZkFailoverTest, AutoScalingHandlerTest, ComputePlanActionTest, TriggerEventQueueTest, TriggerIntegrationTest, OpenCloseCoreStressTest, PluginInfoTest, QueryResultKeyTest, RAMDirectoryFactoryTest, RequestHandlersTest, TestConfigSets, TestCoreDiscovery, TestSimpleTextCodec, TestSolrDeletionPolicy1, TestSolrDeletionPolicy2, TestSolrCloudSnapshots, TestCSVLoader, TestCoreBackup, TestHdfsBackupRestoreCore, LukeRequestHandlerTest, MetricsHandlerTest, SegmentsInfoRequestHandlerTest, ShowFileRequestHandlerTest, StatsReloadRaceTest, TestConfigsApi, TestCoreAdminApis, ZookeeperStatusHandlerTest, BadComponentTest, CustomHighlightComponentTest, DebugComponentTest, FacetPivotSmallTest, InfixSuggestersTest, PhrasesIdentificationComponentTest, ReplicaListTransformerTest, ResponseLogComponentTest, TermVectorComponentTest, TermsComponentTest, JavabinLoaderTest, EmbeddedSolrNoSerializeTest, XmlInterpolationTest, TestUnifiedSolrHighlighter, TestSlowCompositeReaderWrapper, JvmMetricsTest, MetricsConfigTest, SolrMetricManagerTest, SolrMetricReporterTest, SolrMetricsIntegrationTest, TestIntervalFaceting, TestCollationField, TestManagedSchema, LargeFieldTest, QueryEqualityTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=QueryEqualityTest -Dtests.seed=919B75986D291620 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=cs-CZ -Dtests.timezone=America/Catamarca -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | QueryEqualityTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([919B75986D291620]:0)
   [junit4]    > 	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [691/834 (1!)] on J1 in 1.50s, 91 tests, 1 failure <<< FAILURES!

[...truncated 1269 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrClientTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_E333E75639CBE865-001/init-core-data-001
   [junit4]   1> 08:53:31.105 [Thread-375] ERROR org.apache.zookeeper.server.ZooKeeperServer - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   1> 08:53:31.213 [jetty-launcher-78-thread-2] ERROR org.apache.solr.util.StartupLoggingUtils - Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> 08:53:31.213 [jetty-launcher-78-thread-1] ERROR org.apache.solr.util.StartupLoggingUtils - Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> 08:53:31.213 [jetty-launcher-78-thread-3] ERROR org.apache.solr.util.StartupLoggingUtils - Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> -
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   1> -
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> replica:core_node4 rstate:down live:true
   [junit4]   1> -
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> replica:core_node4 rstate:recovering live:true
   [junit4]   1> -
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> replica:core_node4 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   1> -
   [junit4]   1> replica:core_node4 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   1> 08:53:38.766 [TEST-CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale-seed#[E333E75639CBE865]] ERROR org.apache.solr.client.solrj.impl.CloudSolrClient - Request to collection [stale_state_test_col] failed due to (404) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:34179/solr/stale_state_test_col_shard1_replica_n1: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   1> <head>
   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
   [junit4]   1> <title>Error 404 Can not find: /solr/stale_state_test_col_shard1_replica_n1/update</title>
   [junit4]   1> </head>
   [junit4]   1> <body><h2>HTTP ERROR 404</h2>
   [junit4]   1> <p>Problem accessing /solr/stale_state_test_col_shard1_replica_n1/update. Reason:
   [junit4]   1> <pre>    Can not find: /solr/stale_state_test_col_shard1_replica_n1/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>
   [junit4]   1> 
   [junit4]   1> </body>
   [junit4]   1> </html>
   [junit4]   1> , retry? 0
   [junit4]   1> 08:53:49.228 [qtp2065987-1003] ERROR org.apache.solr.handler.RequestHandlerBase - org.apache.solr.common.SolrException: Collection: testalias not found
   [junit4]   1> 	at org.apache.solr.handler.admin.ClusterStatus.getClusterStatus(ClusterStatus.java:103)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.lambda$static$22(CollectionsHandler.java:865)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.execute(CollectionsHandler.java:1177)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:258)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:246)
   [junit4]   1> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
   [junit4]   1> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:734)
   [junit4]   1> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:715)
   [junit4]   1> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:496)
   [junit4]   1> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
   [junit4]   1> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   1> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:724)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   1> 	at org.eclipse.jetty.server.Server.handle(Server.java:531)
   [junit4]   1> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
   [junit4]   1> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
   [junit4]   1> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
   [junit4]   1> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   1> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:291)
   [junit4]   1> 	at org.eclipse.jetty.io.ssl.SslConnection$3.succeeded(SslConnection.java:151)
   [junit4]   1> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   1> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
   [junit4]   1> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   1> 
   [junit4]   1> 08:53:49.235 [qtp2065987-1015] ERROR org.apache.solr.handler.RequestHandlerBase - org.apache.solr.common.SolrException: Collection: testalias not found
   [junit4]   1> 	at org.apache.solr.handler.admin.ClusterStatus.getClusterStatus(ClusterStatus.java:103)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.lambda$static$22(CollectionsHandler.java:865)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.execute(CollectionsHandler.java:1177)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:258)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:246)
   [junit4]   1> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
   [junit4]   1> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:734)
   [junit4]   1> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:715)
   [junit4]   1> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:496)
   [junit4]   1> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
   [junit4]   1> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   1> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:724)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   1> 	at org.eclipse.jetty.server.Server.handle(Server.java:531)
   [junit4]   1> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
   [junit4]   1> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
   [junit4]   1> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
   [junit4]   1> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   1> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:291)
   [junit4]   1> 	at org.eclipse.jetty.io.ssl.SslConnection$3.succeeded(SslConnection.java:151)
   [junit4]   1> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   1> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
   [junit4]   1> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
   [junit4]   1> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   1> 
   [junit4]   1> 08:53:49.333 [qtp2065987-1003] ERROR org.apache.solr.handler.RequestHandlerBase - org.apache.solr.common.SolrException: Collection: testalias2 not found
   [junit4]   1> 	at org.apache.solr.handler.admin.ClusterStatus.getClusterStatus(ClusterStatus.java:103)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.lambda$static$22(CollectionsHandler.java:865)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.execute(CollectionsHandler.java:1177)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:258)
   [junit4]   1> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:246)
   [junit4]   1> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
   [junit4]   1> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:734)
   [junit4]   1> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:715)
   [junit4]   1> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:496)
   [junit4]   1> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
   [junit4]   1> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
   [junit4]   1> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
   [junit4]   1> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   1> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   1

[...truncated too long message...]

true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 13966 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 13966 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 13966 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 0
   [junit4]   2> 13967 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryMLT
   [junit4] OK      0.02s J0 | QueryEqualityTest.testQueryMLT
   [junit4]   2> 13968 INFO  (TEST-QueryEqualityTest.testQueryPrefix-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryPrefix
   [junit4]   2> 13969 INFO  (TEST-QueryEqualityTest.testQueryPrefix-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryPrefix
   [junit4] OK      0.00s J0 | QueryEqualityTest.testQueryPrefix
   [junit4]   2> 13970 INFO  (TEST-QueryEqualityTest.testQueryLucene-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryLucene
   [junit4]   2> 13972 INFO  (TEST-QueryEqualityTest.testQueryLucene-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryLucene
   [junit4] OK      0.00s J0 | QueryEqualityTest.testQueryLucene
   [junit4]   2> 13973 INFO  (TEST-QueryEqualityTest.testDateMathParsingEquality-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDateMathParsingEquality
   [junit4]   2> 13974 INFO  (TEST-QueryEqualityTest.testDateMathParsingEquality-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDateMathParsingEquality
   [junit4] OK      0.00s J0 | QueryEqualityTest.testDateMathParsingEquality
   [junit4]   2> 13976 INFO  (TEST-QueryEqualityTest.testFuncGeohash-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncGeohash
   [junit4]   2> 13976 INFO  (TEST-QueryEqualityTest.testFuncGeohash-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncGeohash
   [junit4] OK      0.00s J0 | QueryEqualityTest.testFuncGeohash
   [junit4]   2> 13977 INFO  (TEST-QueryEqualityTest.testQueryGeofilt-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryGeofilt
   [junit4]   2> 13978 INFO  (TEST-QueryEqualityTest.testQueryGeofilt-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryGeofilt
   [junit4] OK      0.00s J0 | QueryEqualityTest.testQueryGeofilt
   [junit4]   2> 13980 INFO  (TEST-QueryEqualityTest.testQueryBoost-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryBoost
   [junit4]   2> 13980 INFO  (TEST-QueryEqualityTest.testQueryBoost-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryBoost
   [junit4] OK      0.00s J0 | QueryEqualityTest.testQueryBoost
   [junit4]   2> 13982 INFO  (TEST-QueryEqualityTest.testFuncMod-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMod
   [junit4]   2> 13982 INFO  (TEST-QueryEqualityTest.testFuncMod-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMod
   [junit4] OK      0.00s J0 | QueryEqualityTest.testFuncMod
   [junit4]   2> 13984 INFO  (TEST-QueryEqualityTest.testMatchAllDocsQueryXmlParser-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMatchAllDocsQueryXmlParser
   [junit4]   2> 13986 INFO  (TEST-QueryEqualityTest.testMatchAllDocsQueryXmlParser-seed#[919B75986D291620]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMatchAllDocsQueryXmlParser
   [junit4] OK      0.00s J0 | QueryEqualityTest.testMatchAllDocsQueryXmlParser
   [junit4]   2> 13987 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 13987 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=20147428
   [junit4]   2> 13987 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 13987 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1451408: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@a554b5
   [junit4]   2> 13994 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 13994 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2fc2ee: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@16767c9
   [junit4]   2> 13995 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 13995 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c0ee91: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1c2a357
   [junit4]   2> 13995 INFO  (coreCloseExecutor-31-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1420a15
   [junit4]   2> 13995 INFO  (coreCloseExecutor-31-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1420a15
   [junit4]   2> 13995 INFO  (coreCloseExecutor-31-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1ab634b: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@36c32d
   [junit4]   2> 14020 INFO  (SUITE-QueryEqualityTest-seed#[919B75986D291620]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): {lowerfilt=PostingsFormat(name=Direct), id=FST50}, docValues:{_version_=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=560, maxMBSortInHeap=7.529748729025693, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@6dc59), locale=cs-CZ, timezone=America/Catamarca
   [junit4]   2> NOTE: Linux 4.15.0-36-generic i386/Oracle Corporation 1.8.0_172 (32-bit)/cpus=8,threads=1,free=181570344,total=210501632
   [junit4]   2> NOTE: All tests run in this JVM: [QueryEqualityTest, QueryEqualityTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=QueryEqualityTest -Dtests.seed=919B75986D291620 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=cs-CZ -Dtests.timezone=America/Catamarca -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | QueryEqualityTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([919B75986D291620]:0)
   [junit4]    > 	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [5/5 (5!)] on J0 in 3.41s, 91 tests, 1 failure <<< FAILURES!

[...truncated 15 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 5 suites, 455 tests, 5 suite-level errors [seed: 919B75986D291620]

Total time: 16 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.client.solrj.impl.CloudSolrClientTest
[repro]   5/5 failed: org.apache.solr.search.QueryEqualityTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=3e87499d72131f2ee54b03fa83ed177413fd3cbc, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23089
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_172) - Build # 23089 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23089/
Java: 64bit/jdk1.8.0_172 -XX:+UseCompressedOops -XX:+UseParallelGC

4 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([AB4A85D3378889D0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([AB4A85D3378889D0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([AB4A85D3378889D0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([AB4A85D3378889D0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 15036 lines...]
   [junit4] Suite: org.apache.solr.search.QueryEqualityTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.search.QueryEqualityTest_AB4A85D3378889D0-001/init-core-data-001
   [junit4]   2> 2407990 WARN  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=24 numCloses=24
   [junit4]   2> 2407990 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2407992 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2407992 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2407993 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 2407993 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2408016 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2408033 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 2408090 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2408263 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2408263 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2408272 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54844eb1
   [junit4]   2> 2408276 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54844eb1
   [junit4]   2> 2408276 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54844eb1
   [junit4]   2> 2408277 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2408302 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2408318 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 2408354 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2408357 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 2408357 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54844eb1
   [junit4]   2> 2408357 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.search.QueryEqualityTest_AB4A85D3378889D0-001/init-core-data-001/]
   [junit4]   2> 2408358 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=39.712890625, floorSegmentMB=2.00390625, forceMergeDeletesPctAllowed=26.04004510952343, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.886117670030847, deletesPctAllowed=33.10316133559507
   [junit4]   2> 2408381 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2408381 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2408382 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2408382 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2408382 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 2408383 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@63d2d435[collection1] main]
   [junit4]   2> 2408383 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 2408585 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 2408803 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2408803 INFO  (searcherExecutor-9382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 2408803 INFO  (coreLoadExecutor-9381-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1615270676218773504
   [junit4]   2> 2408803 INFO  (searcherExecutor-9382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 2408803 INFO  (searcherExecutor-9382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 2408803 INFO  (searcherExecutor-9382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 2408803 INFO  (searcherExecutor-9382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 2408803 INFO  (searcherExecutor-9382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 2408804 INFO  (searcherExecutor-9382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 2408804 INFO  (searcherExecutor-9382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 2408804 INFO  (searcherExecutor-9382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 2408804 INFO  (searcherExecutor-9382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@63d2d435[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2408806 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 2408811 INFO  (TEST-QueryEqualityTest.testFuncMathConsts-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMathConsts
   [junit4]   2> 2408811 INFO  (TEST-QueryEqualityTest.testFuncMathConsts-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMathConsts
   [junit4]   2> 2408816 INFO  (TEST-QueryEqualityTest.testFuncMod-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMod
   [junit4]   2> 2408816 INFO  (TEST-QueryEqualityTest.testFuncMod-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMod
   [junit4]   2> 2408821 INFO  (TEST-QueryEqualityTest.testFuncQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncQuery
   [junit4]   2> 2408822 INFO  (TEST-QueryEqualityTest.testFuncQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncQuery
   [junit4]   2> 2408826 INFO  (TEST-QueryEqualityTest.testFuncVector-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncVector
   [junit4]   2> 2408826 INFO  (TEST-QueryEqualityTest.testFuncVector-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncVector
   [junit4]   2> 2408831 INFO  (TEST-QueryEqualityTest.testQuerySurround-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQuerySurround
   [junit4]   2> 2408853 INFO  (TEST-QueryEqualityTest.testQuerySurround-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQuerySurround
   [junit4]   2> 2408857 INFO  (TEST-QueryEqualityTest.testFuncMin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMin
   [junit4]   2> 2408857 INFO  (TEST-QueryEqualityTest.testFuncMin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMin
   [junit4]   2> 2408862 INFO  (TEST-QueryEqualityTest.testFuncRord-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncRord
   [junit4]   2> 2408863 INFO  (TEST-QueryEqualityTest.testFuncRord-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncRord
   [junit4]   2> 2408866 INFO  (TEST-QueryEqualityTest.testQueryMaxScore-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryMaxScore
   [junit4]   2> 2408867 INFO  (TEST-QueryEqualityTest.testQueryMaxScore-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryMaxScore
   [junit4]   2> 2408872 INFO  (TEST-QueryEqualityTest.testFuncMaxdoc-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMaxdoc
   [junit4]   2> 2408877 INFO  (TEST-QueryEqualityTest.testFuncMaxdoc-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMaxdoc
   [junit4]   2> 2408883 INFO  (TEST-QueryEqualityTest.testGraphTermsQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testGraphTermsQuery
   [junit4]   2> 2408886 INFO  (TEST-QueryEqualityTest.testGraphTermsQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testGraphTermsQuery
   [junit4]   2> 2408891 INFO  (TEST-QueryEqualityTest.testPayloadCheckQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testPayloadCheckQuery
   [junit4]   2> 2408899 INFO  (TEST-QueryEqualityTest.testPayloadCheckQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testPayloadCheckQuery
   [junit4]   2> 2408903 INFO  (TEST-QueryEqualityTest.testFuncNot-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncNot
   [junit4]   2> 2408905 INFO  (TEST-QueryEqualityTest.testFuncNot-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncNot
   [junit4]   2> 2408910 INFO  (TEST-QueryEqualityTest.testQuerySimple-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQuerySimple
   [junit4]   2> 2408916 INFO  (TEST-QueryEqualityTest.testQuerySimple-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQuerySimple
   [junit4]   2> 2408925 INFO  (TEST-QueryEqualityTest.testTlogitQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTlogitQuery
   [junit4]   2> 2408928 INFO  (TEST-QueryEqualityTest.testTlogitQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTlogitQuery
   [junit4]   2> 2408933 INFO  (TEST-QueryEqualityTest.testFuncCscore-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncCscore
   [junit4]   2> 2408934 INFO  (TEST-QueryEqualityTest.testFuncCscore-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncCscore
   [junit4]   2> 2408939 INFO  (TEST-QueryEqualityTest.testPayloadScoreQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testPayloadScoreQuery
   [junit4]   2> 2408943 INFO  (TEST-QueryEqualityTest.testPayloadScoreQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testPayloadScoreQuery
   [junit4]   2> 2408947 INFO  (TEST-QueryEqualityTest.testFuncMax-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMax
   [junit4]   2> 2408947 INFO  (TEST-QueryEqualityTest.testFuncMax-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMax
   [junit4]   2> 2408952 INFO  (TEST-QueryEqualityTest.testFuncRelatedness-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncRelatedness
   [junit4]   2> 2408960 INFO  (TEST-QueryEqualityTest.testFuncRelatedness-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncRelatedness
   [junit4]   2> 2408966 INFO  (TEST-QueryEqualityTest.testFuncOrd-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncOrd
   [junit4]   2> 2408967 INFO  (TEST-QueryEqualityTest.testFuncOrd-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncOrd
   [junit4]   2> 2408973 INFO  (TEST-QueryEqualityTest.testTestFuncs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTestFuncs
   [junit4]   2> 2408976 INFO  (TEST-QueryEqualityTest.testTestFuncs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTestFuncs
   [junit4]   2> 2408980 INFO  (TEST-QueryEqualityTest.testFuncHsin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncHsin
   [junit4]   2> 2408981 INFO  (TEST-QueryEqualityTest.testFuncHsin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncHsin
   [junit4]   2> 2408986 INFO  (TEST-QueryEqualityTest.testIGainQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testIGainQuery
   [junit4]   2> 2408988 INFO  (TEST-QueryEqualityTest.testIGainQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testIGainQuery
   [junit4]   2> 2408992 INFO  (TEST-QueryEqualityTest.testQueryTerm-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryTerm
   [junit4]   2> 2408992 INFO  (TEST-QueryEqualityTest.testQueryTerm-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryTerm
   [junit4]   2> 2408997 INFO  (TEST-QueryEqualityTest.testFuncSqedist-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncSqedist
   [junit4]   2> 2408998 INFO  (TEST-QueryEqualityTest.testFuncSqedist-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncSqedist
   [junit4]   2> 2409003 INFO  (TEST-QueryEqualityTest.testFuncStrdist-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncStrdist
   [junit4]   2> 2409005 INFO  (TEST-QueryEqualityTest.testFuncStrdist-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncStrdist
   [junit4]   2> 2409009 INFO  (TEST-QueryEqualityTest.testFuncSum-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncSum
   [junit4]   2> 2409010 INFO  (TEST-QueryEqualityTest.testFuncSum-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncSum
   [junit4]   2> 2409013 INFO  (TEST-QueryEqualityTest.testParserCoverage-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testParserCoverage
   [junit4]   2> 2409013 INFO  (TEST-QueryEqualityTest.testParserCoverage-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testParserCoverage
   [junit4]   2> 2409016 INFO  (TEST-QueryEqualityTest.testQuerySwitch-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQuerySwitch
   [junit4]   2> 2409017 INFO  (TEST-QueryEqualityTest.testQuerySwitch-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQuerySwitch
   [junit4]   2> 2409022 INFO  (TEST-QueryEqualityTest.testFuncSttf-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncSttf
   [junit4]   2> 2409023 INFO  (TEST-QueryEqualityTest.testFuncSttf-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncSttf
   [junit4]   2> 2409026 INFO  (TEST-QueryEqualityTest.testFuncScale-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncScale
   [junit4]   2> 2409028 INFO  (TEST-QueryEqualityTest.testFuncScale-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncScale
   [junit4]   2> 2409031 INFO  (TEST-QueryEqualityTest.testFuncDoubleValueMathFuncs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDoubleValueMathFuncs
   [junit4]   2> 2409033 INFO  (TEST-QueryEqualityTest.testFuncDoubleValueMathFuncs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDoubleValueMathFuncs
   [junit4]   2> 2409037 INFO  (TEST-QueryEqualityTest.testFuncSub-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncSub
   [junit4]   2> 2409038 INFO  (TEST-QueryEqualityTest.testFuncSub-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncSub
   [junit4]   2> 2409043 INFO  (TEST-QueryEqualityTest.testLocalParamsWithRepeatingParam-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLocalParamsWithRepeatingParam
   [junit4]   2> 2409044 INFO  (TEST-QueryEqualityTest.testLocalParamsWithRepeatingParam-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testLocalParamsWithRepeatingParam
   [junit4]   2> 2409048 INFO  (TEST-QueryEqualityTest.testQueryPrefix-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryPrefix
   [junit4]   2> 2409048 INFO  (TEST-QueryEqualityTest.testQueryPrefix-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryPrefix
   [junit4]   2> 2409052 INFO  (TEST-QueryEqualityTest.testReRankQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testReRankQuery
   [junit4]   2> 2409053 INFO  (TEST-QueryEqualityTest.testReRankQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testReRankQuery
   [junit4]   2> 2409056 INFO  (TEST-QueryEqualityTest.testQueryFunc-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryFunc
   [junit4]   2> 2409057 INFO  (TEST-QueryEqualityTest.testQueryFunc-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryFunc
   [junit4]   2> 2409061 INFO  (TEST-QueryEqualityTest.testField-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testField
   [junit4]   2> 2409061 INFO  (TEST-QueryEqualityTest.testField-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testField
   [junit4]   2> 2409066 INFO  (TEST-QueryEqualityTest.testQueryRaw-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryRaw
   [junit4]   2> 2409066 INFO  (TEST-QueryEqualityTest.testQueryRaw-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryRaw
   [junit4]   2> 2409071 INFO  (TEST-QueryEqualityTest.testFuncSingleValueMathFuncs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncSingleValueMathFuncs
   [junit4]   2> 2409072 INFO  (TEST-QueryEqualityTest.testFuncSingleValueMathFuncs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncSingleValueMathFuncs
   [junit4]   2> 2409077 INFO  (TEST-QueryEqualityTest.testQueryNested-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryNested
   [junit4]   2> 2409077 INFO  (TEST-QueryEqualityTest.testQueryNested-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryNested
   [junit4]   2> 2409084 INFO  (TEST-QueryEqualityTest.testFuncMap-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMap
   [junit4]   2> 2409086 INFO  (TEST-QueryEqualityTest.testFuncMap-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMap
   [junit4]   2> 2409090 INFO  (TEST-QueryEqualityTest.testFuncRecip-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncRecip
   [junit4]   2> 2409090 INFO  (TEST-QueryEqualityTest.testFuncRecip-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncRecip
   [junit4]   2> 2409094 INFO  (TEST-QueryEqualityTest.testBlockJoin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBlockJoin
   [junit4]   2> 2409097 INFO  (TEST-QueryEqualityTest.testBlockJoin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBlockJoin
   [junit4]   2> 2409102 INFO  (TEST-QueryEqualityTest.testFuncTestfunc-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncTestfunc
   [junit4]   2> 2409103 INFO  (TEST-QueryEqualityTest.testFuncTestfunc-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncTestfunc
   [junit4]   2> 2409107 INFO  (TEST-QueryEqualityTest.testFuncMs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMs
   [junit4]   2> 2409108 INFO  (TEST-QueryEqualityTest.testFuncMs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMs
   [junit4]   2> 2409112 INFO  (TEST-QueryEqualityTest.testDateMathParsingEquality-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDateMathParsingEquality
   [junit4]   2> 2409112 INFO  (TEST-QueryEqualityTest.testDateMathParsingEquality-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDateMathParsingEquality
   [junit4]   2> 2409116 INFO  (TEST-QueryEqualityTest.testFuncGeodist-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncGeodist
   [junit4]   2> 2409117 INFO  (TEST-QueryEqualityTest.testFuncGeodist-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncGeodist
   [junit4]   2> 2409121 INFO  (TEST-QueryEqualityTest.testQueryDismax-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryDismax
   [junit4]   2> 2409122 INFO  (TEST-QueryEqualityTest.testQueryDismax-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryDismax
   [junit4]   2> 2409126 INFO  (TEST-QueryEqualityTest.testSignificantTermsQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSignificantTermsQuery
   [junit4]   2> 2409128 INFO  (TEST-QueryEqualityTest.testSignificantTermsQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testSignificantTermsQuery
   [junit4]   2> 2409132 INFO  (TEST-QueryEqualityTest.testFuncConcat-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncConcat
   [junit4]   2> 2409137 INFO  (TEST-QueryEqualityTest.testFuncConcat-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncConcat
   [junit4]   2> 2409141 INFO  (TEST-QueryEqualityTest.testPayloadFunction-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testPayloadFunction
   [junit4]   2> 2409143 INFO  (TEST-QueryEqualityTest.testPayloadFunction-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testPayloadFunction
   [junit4]   2> 2409147 INFO  (TEST-QueryEqualityTest.testQueryScoreJoin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryScoreJoin
   [junit4]   2> 2409147 INFO  (TEST-QueryEqualityTest.testQueryScoreJoin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryScoreJoin
   [junit4]   2> 2409150 INFO  (TEST-QueryEqualityTest.testCompares-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCompares
   [junit4]   2> 2409158 INFO  (TEST-QueryEqualityTest.testCompares-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCompares
   [junit4]   2> 2409162 INFO  (TEST-QueryEqualityTest.testBoolQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBoolQuery
   [junit4]   2> 2409162 INFO  (TEST-QueryEqualityTest.testBoolQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBoolQuery
   [junit4]   2> 2409166 INFO  (TEST-QueryEqualityTest.testQueryCollapse-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryCollapse
   [junit4]   2> 2409166 INFO  (TEST-QueryEqualityTest.testQueryCollapse-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryCollapse
   [junit4]   2> 2409170 INFO  (TEST-QueryEqualityTest.testTerms-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTerms
   [junit4]   2> 2409170 INFO  (TEST-QueryEqualityTest.testTerms-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTerms
   [junit4]   2> 2409174 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryMLT
   [junit4]   2> 2409175 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1 (1615270676607795200)]} 0 1
   [junit4]   2> 2409177 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1615270676610940928,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2409177 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@44ea42dd commitCommandVersion:1615270676610940928
   [junit4]   2> 2409179 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5ffc94cf[collection1] main]
   [junit4]   2> 2409180 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2409181 INFO  (searcherExecutor-9382-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5ffc94cf[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
   [junit4]   2> 2409181 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 2409185 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1615270676619329536,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2409185 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 2409186 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2409186 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 0
   [junit4]   2> 2409186 INFO  (TEST-QueryEqualityTest.testQueryMLT-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryMLT
   [junit4]   2> 2409190 INFO  (TEST-QueryEqualityTest.testExportQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testExportQuery
   [junit4]   2> 2409191 INFO  (TEST-QueryEqualityTest.testExportQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testExportQuery
   [junit4]   2> 2409195 INFO  (TEST-QueryEqualityTest.testFuncField-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncField
   [junit4]   2> 2409197 INFO  (TEST-QueryEqualityTest.testFuncField-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncField
   [junit4]   2> 2409200 INFO  (TEST-QueryEqualityTest.testFuncDiv-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDiv
   [junit4]   2> 2409201 INFO  (TEST-QueryEqualityTest.testFuncDiv-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDiv
   [junit4]   2> 2409205 INFO  (TEST-QueryEqualityTest.testFuncTop-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncTop
   [junit4]   2> 2409205 INFO  (TEST-QueryEqualityTest.testFuncTop-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncTop
   [junit4]   2> 2409211 INFO  (TEST-QueryEqualityTest.testFuncTerms-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncTerms
   [junit4]   2> 2409217 INFO  (TEST-QueryEqualityTest.testFuncTerms-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncTerms
   [junit4]   2> 2409222 INFO  (TEST-QueryEqualityTest.testFuncLiteral-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncLiteral
   [junit4]   2> 2409223 INFO  (TEST-QueryEqualityTest.testFuncLiteral-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncLiteral
   [junit4]   2> 2409229 INFO  (TEST-QueryEqualityTest.testFuncProduct-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncProduct
   [junit4]   2> 2409230 INFO  (TEST-QueryEqualityTest.testFuncProduct-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncProduct
   [junit4]   2> 2409234 INFO  (TEST-QueryEqualityTest.testQueryGeofilt-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryGeofilt
   [junit4]   2> 2409236 INFO  (TEST-QueryEqualityTest.testQueryGeofilt-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryGeofilt
   [junit4]   2> 2409241 INFO  (TEST-QueryEqualityTest.testQueryFrange-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryFrange
   [junit4]   2> 2409241 INFO  (TEST-QueryEqualityTest.testQueryFrange-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryFrange
   [junit4]   2> 2409247 INFO  (TEST-QueryEqualityTest.testQueryLucene-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryLucene
   [junit4]   2> 2409248 INFO  (TEST-QueryEqualityTest.testQueryLucene-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryLucene
   [junit4]   2> 2409252 INFO  (TEST-QueryEqualityTest.testFuncGhhsin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncGhhsin
   [junit4]   2> 2409253 INFO  (TEST-QueryEqualityTest.testFuncGhhsin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncGhhsin
   [junit4]   2> 2409257 INFO  (TEST-QueryEqualityTest.testFuncExists-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncExists
   [junit4]   2> 2409258 INFO  (TEST-QueryEqualityTest.testFuncExists-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncExists
   [junit4]   2> 2409262 INFO  (TEST-QueryEqualityTest.testAggs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAggs
   [junit4]   2> 2409279 INFO  (TEST-QueryEqualityTest.testAggs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testAggs
   [junit4]   2> 2409282 INFO  (TEST-QueryEqualityTest.testFilters-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFilters
   [junit4]   2> 2409283 INFO  (TEST-QueryEqualityTest.testFilters-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFilters
   [junit4]   2> 2409287 INFO  (TEST-QueryEqualityTest.testQueryBoost-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryBoost
   [junit4]   2> 2409287 INFO  (TEST-QueryEqualityTest.testQueryBoost-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryBoost
   [junit4]   2> 2409292 INFO  (TEST-QueryEqualityTest.testFuncLinear-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncLinear
   [junit4]   2> 2409294 INFO  (TEST-QueryEqualityTest.testFuncLinear-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncLinear
   [junit4]   2> 2409298 INFO  (TEST-QueryEqualityTest.testHash-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testHash
   [junit4]   2> 2409302 INFO  (TEST-QueryEqualityTest.testHash-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testHash
   [junit4]   2> 2409306 INFO  (TEST-QueryEqualityTest.testFuncNorm-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncNorm
   [junit4]   2> 2409307 INFO  (TEST-QueryEqualityTest.testFuncNorm-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncNorm
   [junit4]   2> 2409312 INFO  (TEST-QueryEqualityTest.testFuncNumdocs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncNumdocs
   [junit4]   2> 2409313 INFO  (TEST-QueryEqualityTest.testFuncNumdocs-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncNumdocs
   [junit4]   2> 2409317 INFO  (TEST-QueryEqualityTest.testFuncJoindf-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncJoindf
   [junit4]   2> 2409319 INFO  (TEST-QueryEqualityTest.testFuncJoindf-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncJoindf
   [junit4]   2> 2409324 INFO  (TEST-QueryEqualityTest.testFuncGeohash-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncGeohash
   [junit4]   2> 2409325 INFO  (TEST-QueryEqualityTest.testFuncGeohash-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncGeohash
   [junit4]   2> 2409330 INFO  (TEST-QueryEqualityTest.testQueryComplexPhrase-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryComplexPhrase
   [junit4]   2> 2409357 INFO  (TEST-QueryEqualityTest.testQueryComplexPhrase-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryComplexPhrase
   [junit4]   2> 2409363 INFO  (TEST-QueryEqualityTest.testFuncDef-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDef
   [junit4]   2> 2409366 INFO  (TEST-QueryEqualityTest.testFuncDef-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDef
   [junit4]   2> 2409372 INFO  (TEST-QueryEqualityTest.testFuncBools-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncBools
   [junit4]   2> 2409373 INFO  (TEST-QueryEqualityTest.testFuncBools-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncBools
   [junit4]   2> 2409378 INFO  (TEST-QueryEqualityTest.testQueryBbox-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryBbox
   [junit4]   2> 2409379 INFO  (TEST-QueryEqualityTest.testQueryBbox-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryBbox
   [junit4]   2> 2409384 INFO  (TEST-QueryEqualityTest.testGraphQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testGraphQuery
   [junit4]   2> 2409387 INFO  (TEST-QueryEqualityTest.testGraphQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testGraphQuery
   [junit4]   2> 2409392 INFO  (TEST-QueryEqualityTest.testFuncBoost-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncBoost
   [junit4]   2> 2409392 INFO  (TEST-QueryEqualityTest.testFuncBoost-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncBoost
   [junit4]   2> 2409396 INFO  (TEST-QueryEqualityTest.testFuncDist-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDist
   [junit4]   2> 2409397 INFO  (TEST-QueryEqualityTest.testFuncDist-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDist
   [junit4]   2> 2409401 INFO  (TEST-QueryEqualityTest.testMatchAllDocsQueryXmlParser-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMatchAllDocsQueryXmlParser
   [junit4]   2> 2409403 INFO  (TEST-QueryEqualityTest.testMatchAllDocsQueryXmlParser-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMatchAllDocsQueryXmlParser
   [junit4]   2> 2409406 INFO  (TEST-QueryEqualityTest.testFuncCurrency-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncCurrency
   [junit4]   2> 2409408 INFO  (TEST-QueryEqualityTest.testFuncCurrency-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncCurrency
   [junit4]   2> 2409412 INFO  (TEST-QueryEqualityTest.testFuncDoubleValueBools-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDoubleValueBools
   [junit4]   2> 2409414 INFO  (TEST-QueryEqualityTest.testFuncDoubleValueBools-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDoubleValueBools
   [junit4]   2> 2409417 INFO  (TEST-QueryEqualityTest.testChildField-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testChildField
   [junit4]   2> 2409420 INFO  (TEST-QueryEqualityTest.testChildField-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testChildField
   [junit4]   2> 2409423 INFO  (TEST-QueryEqualityTest.testQueryJoin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryJoin
   [junit4]   2> 2409425 INFO  (TEST-QueryEqualityTest.testQueryJoin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryJoin
   [junit4]   2> 2409429 INFO  (TEST-QueryEqualityTest.testFuncIf-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncIf
   [junit4]   2> 2409429 INFO  (TEST-QueryEqualityTest.testFuncIf-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncIf
   [junit4]   2> 2409429 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 2409429 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=180241400
   [junit4]   2> 2409430 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2409430 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@770c27c8: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@26372bd7
   [junit4]   2> 2409432 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2409432 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@e439faa: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1f717da
   [junit4]   2> 2409434 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2409434 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@35242739: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7087c625
   [junit4]   2> 2409434 INFO  (coreCloseExecutor-9387-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1dc97050
   [junit4]   2> 2409434 INFO  (coreCloseExecutor-9387-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1dc97050
   [junit4]   2> 2409434 INFO  (coreCloseExecutor-9387-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@593b72ec: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@34d6808
   [junit4]   2> 2409454 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Lucene80, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4694d47a), locale=ja-JP, timezone=America/Menominee
   [junit4]   2> NOTE: Linux 4.15.0-36-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=8,threads=1,free=216872072,total=527958016
   [junit4]   2> NOTE: All tests run in this JVM: [Tagger2Test, TestManagedResource, SuggesterFSTTest, SimplePostToolTest, TestDirectoryFactory, TestFastLRUCache, TestSafeXMLParsing, FullSolrCloudDistribCmdsTest, CachingDirectoryFactoryTest, StatsComponentTest, SegmentsInfoRequestHandlerTest, CoreMergeIndexesAdminHandlerTest, TestRandomDVFaceting, TestReRankQParserPlugin, BadComponentTest, HttpPartitionTest, SpellingQueryConverterTest, HighlighterMaxOffsetTest, TestDocSet, TestQueryTypes, TestCloudPivotFacet, SearchRateTriggerTest, TestWithCollection, TestSolrCloudSnapshots, TestLegacyField, DistributedVersionInfoTest, CollectionPropsTest, HdfsAutoAddReplicasIntegrationTest, DistributedQueryComponentCustomSortTest, SolrJmxReporterTest, SolrCmdDistributorTest, TestRequestStatusCollectionAPI, TestScoreJoinQPScore, CreateCollectionCleanupTest, ImplicitSnitchTest, AnalysisAfterCoreReloadTest, TestConfigSetsAPIExclusivity, SpatialHeatmapFacetsTest, TestDeleteCollectionOnDownNodes, TestMaxScoreQueryParser, TestCoreDiscovery, TestPerFieldSimilarity, SolrGangliaReporterTest, TestSmileRequest, TestCloudDeleteByQuery, SignificantTermsQParserPluginTest, SolrCloudExampleTest, TestRandomRequestDistribution, TestNumericRangeQuery64, TestTolerantUpdateProcessorCloud, FacetPivotSmallTest, SuggesterWFSTTest, RAMDirectoryFactoryTest, TestPullReplica, DistributedDebugComponentTest, SpatialRPTFieldTypeTest, TestUnifiedSolrHighlighter, TestDocTermOrdsUninvertLimit, BlockJoinFacetRandomTest, TestStressUserVersions, TestDistributedMissingSort, AtomicUpdateProcessorFactoryTest, TestFieldTypeCollectionResource, TestFiltering, DistributedSpellCheckComponentTest, PeerSyncTest, TestSolrConfigHandler, TestAddFieldRealTimeGet, NodeMarkersRegistrationTest, DateMathParserTest, RestartWhileUpdatingTest, TestDistributedStatsComponentCardinality, HDFSCollectionsAPITest, TestRandomCollapseQParserPlugin, TestSQLHandler, TestSolrQueryResponse, OverseerTaskQueueTest, TestFaceting, SOLR749Test, IndexSchemaRuntimeFieldTest, TestUseDocValuesAsStored2, OpenExchangeRatesOrgProviderTest, TestFieldCacheWithThreads, TestSimNodeAddedTrigger, JvmMetricsTest, SchemaApiFailureTest, RequestLoggingTest, TestMultiWordSynonyms, TestSchemalessBufferedUpdates, SolrMetricManagerTest, EchoParamsTest, URLClassifyProcessorTest, DirectSolrConnectionTest, TestSerializedLuceneMatchVersion, AutoScalingHandlerTest, CopyFieldTest, MoveReplicaHDFSFailoverTest, ParsingFieldUpdateProcessorsTest, PreAnalyzedFieldTest, TestBulkSchemaAPI, TestExactSharedStatsCache, TestTestInjection, HdfsChaosMonkeyNothingIsSafeTest, TestSchemaResource, DateRangeFieldTest, TriggerSetPropertiesIntegrationTest, TestFieldCacheSort, DistribDocExpirationUpdateProcessorTest, ScheduledTriggerIntegrationTest, TestFuzzyAnalyzedSuggestions, SystemInfoHandlerTest, TestUpdate, FieldMutatingUpdateProcessorTest, DistanceFunctionTest, UpdateRequestProcessorFactoryTest, TestStressLucene, CursorPagingTest, DistributedFacetPivotSmallTest, BigEndianAscendingWordDeserializerTest, TestMiniSolrCloudClusterSSL, DefaultValueUpdateProcessorTest, SaslZkACLProviderTest, TestSimDistribStateManager, UtilsToolTest, AnalyticsQueryTest, MetricsHistoryHandlerTest, CollectionsAPIAsyncDistributedZkTest, ConcurrentCreateRoutedAliasTest, TriggerCooldownIntegrationTest, TestLegacyTerms, SharedFSAutoReplicaFailoverTest, HdfsRecoverLeaseTest, DistributedFacetPivotLargeTest, HdfsDirectoryTest, AlternateDirectoryTest, PathHierarchyTokenizerFactoryTest, BasicDistributedZkTest, BasicZkTest, ChaosMonkeySafeLeaderTest, CleanupOldIndexTest, ClusterStateTest, ClusterStateUpdateTest, DeleteNodeTest, DeleteShardTest, DeleteStatusTest, DistribCursorPagingTest, LeaderElectionTest, LeaderTragicEventTest, MultiSolrCloudTestCaseTest, MultiThreadedOCPTest, ReplaceNodeTest, TestClusterProperties, TestConfigSetsAPI, TestLockTree, TestSSLRandomization, TestSegmentSorting, TestStressCloudBlindAtomicUpdates, UnloadDistributedZkTest, VMParamsZkACLAndCredentialsProvidersTest, ZkCLITest, ZkControllerTest, ZkNodePropsTest, ZkShardTermsTest, ZkSolrClientTest, CollectionTooManyReplicasTest, SimpleCollectionCreateDeleteTest, TestCollectionsAPIViaSolrCloudCluster, TestHdfsCloudBackupRestore, MetricTriggerIntegrationTest, MetricTriggerTest, NodeAddedTriggerTest, NodeLostTriggerIntegrationTest, TestSimExtremeIndexing, TestSimLargeCluster, TestSimTriggerIntegration, BaseCdcrDistributedZkTest, CdcrBidirectionalTest, CdcrBootstrapTest, CdcrReplicationHandlerTest, CdcrRequestHandlerTest, CdcrVersionReplicationTest, CdcrWithNodesRestartsTest, TermVectorComponentDistributedTest, TermVectorComponentTest, TermsComponentTest, TestExportWriter, JavabinLoaderTest, EmbeddedSolrNoSerializeTest, RandomizedTaggerTest, XmlInterpolationTest, FastVectorHighlighterTest, HighlighterConfigTest, WrapperMergePolicyFactoryTest, CheckHdfsIndexTest, SolrShardReporterTest, TestDynamicFieldResource, TestFieldCollectionResource, TestFieldResource, TestManagedSynonymFilterFactory, TestManagedSynonymGraphFilterFactory, BooleanFieldTest, ChangedSchemaMergeTest, DocValuesTest, TestCloudManagedSchema, TestCloudSchemaless, QueryEqualityTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=QueryEqualityTest -Dtests.seed=AB4A85D3378889D0 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ja-JP -Dtests.timezone=America/Menominee -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | QueryEqualityTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([AB4A85D3378889D0]:0)
   [junit4]    > 	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [700/834 (1!)] on J0 in 1.48s, 91 tests, 1 failure <<< FAILURES!

[...truncated 49281 lines...]
[asciidoctor:convert] asciidoctor: ERROR: about-this-guide.adoc: line 1: invalid part, must have at least one section (e.g., chapter, appendix, etc.)
[asciidoctor:convert] asciidoctor: ERROR: solr-glossary.adoc: line 1: invalid part, must have at least one section (e.g., chapter, appendix, etc.)
     [java] Processed 2435 links (1987 relative) to 3183 anchors in 247 files
     [echo] Validated Links & Anchors via: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-ref-guide/bare-bones-html/

-documentation-lint:
    [jtidy] Checking for broken html (such as invalid tags)...
   [delete] Deleting directory /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/jtidy_tmp
     [echo] Checking for broken links...
     [exec] 
     [exec] Crawl/parse...
     [exec] 
     [exec] Verify...
     [echo] Checking for malformed docs...

jar-checksums:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

common.resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/null238081042
     [copy] Copying 35 files to /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/null238081042
   [delete] Deleting directory /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/null238081042

resolve-example:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

resolve-server:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/null812620663
     [copy] Copying 240 files to /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/null812620663
   [delete] Deleting directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/null812620663

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] 	found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] 	found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] 	found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] 	found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] 	found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 205ms :: artifacts dl 1ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
	---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 82 minutes 37 seconds
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[Lucene-Solr-master-Linux] $ /bin/sh -xe /tmp/jenkins2024451443346227177.sh
+ mv lucene/build lucene/build.orig
+ mv solr/build solr/build.orig
+ export ANT_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
+ export PATH=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/bin:/home/jenkins/tools/java/64bit/jdk1.8.0_172/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ python3 -u dev-tools/scripts/reproduceJenkinsFailures.py --no-git https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23089/consoleText
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23089/consoleText

[repro] Revision: 3e87499d72131f2ee54b03fa83ed177413fd3cbc

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line:  ant test  -Dtestcase=QueryEqualityTest -Dtests.seed=AB4A85D3378889D0 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ja-JP -Dtests.timezone=America/Menominee -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] ant clean
Buildfile: /home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml

clean:

clean:

clean:

BUILD SUCCESSFUL
Total time: 0 seconds
[repro] Test suites by module:
[repro]    solr/core
[repro]       QueryEqualityTest
[repro] ant compile-test
Buildfile: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/build.xml

check-analyzers-icu-uptodate:

jar-analyzers-icu:

-mrjar-classes-uptodate:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 294ms :: artifacts dl 2ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
	---------------------------------------------------------------------

check-analyzers-common-uptodate:

jar-analyzers-common:

-mrjar-classes-uptodate:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve-groovy:

-check-git-state:

-git-cleanroot:

-copy-git-state:
     [copy] Copying 1 file to /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build

git-autoclean:

resolve:

common.init:

compile-lucene-core:

-check-git-state:

-git-cleanroot:

-copy-git-state:

git-autoclean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

init:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

compile-core:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java
    [javac] Compiling 869 source files to /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/util/graph/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/document/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/util/bkd/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/compressing/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene60/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene80/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/util/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/index/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/util/fst/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/analysis/tokenattributes/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/search/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/util/packed/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/util/mutable/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene70/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/perfield/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/analysis/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/analysis/standard/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/store/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/blocktree/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/search/spans/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/search/similarities/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/util/automaton/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene50/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java/org/apache/lucene/geo/package-info.class
     [copy] Copying 3 files to /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java

init:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

compile-core:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java
    [javac] Compiling 472 source files to /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/hunspell/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/minhash/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/ga/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/ca/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/custom/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/sr/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/collation/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/sv/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/bg/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/payloads/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/ngram/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/core/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/bn/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/fr/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/tartarus/snowball/ext/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/br/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/miscellaneous/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/sinks/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/cjk/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/synonym/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/wikipedia/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/fa/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/classes/java/org/apache/lucene/analysis/reverse/package-info.class
    [javac] Creating empty /home/jenkins/workspace/

[...truncated too long message...]

ding testQueryBbox
   [junit4] OK      0.00s J1 | QueryEqualityTest.testQueryBbox
   [junit4]   2> 9442 INFO  (TEST-QueryEqualityTest.testGraphQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testGraphQuery
   [junit4]   2> 9444 INFO  (TEST-QueryEqualityTest.testGraphQuery-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testGraphQuery
   [junit4] OK      0.01s J1 | QueryEqualityTest.testGraphQuery
   [junit4]   2> 9445 INFO  (TEST-QueryEqualityTest.testFuncBoost-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncBoost
   [junit4]   2> 9445 INFO  (TEST-QueryEqualityTest.testFuncBoost-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncBoost
   [junit4] OK      0.00s J1 | QueryEqualityTest.testFuncBoost
   [junit4]   2> 9447 INFO  (TEST-QueryEqualityTest.testFuncDist-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDist
   [junit4]   2> 9447 INFO  (TEST-QueryEqualityTest.testFuncDist-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDist
   [junit4] OK      0.00s J1 | QueryEqualityTest.testFuncDist
   [junit4]   2> 9448 INFO  (TEST-QueryEqualityTest.testMatchAllDocsQueryXmlParser-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMatchAllDocsQueryXmlParser
   [junit4]   2> 9451 INFO  (TEST-QueryEqualityTest.testMatchAllDocsQueryXmlParser-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMatchAllDocsQueryXmlParser
   [junit4] OK      0.00s J1 | QueryEqualityTest.testMatchAllDocsQueryXmlParser
   [junit4]   2> 9452 INFO  (TEST-QueryEqualityTest.testFuncCurrency-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncCurrency
   [junit4]   2> 9453 INFO  (TEST-QueryEqualityTest.testFuncCurrency-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncCurrency
   [junit4] OK      0.00s J1 | QueryEqualityTest.testFuncCurrency
   [junit4]   2> 9454 INFO  (TEST-QueryEqualityTest.testFuncDoubleValueBools-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncDoubleValueBools
   [junit4]   2> 9455 INFO  (TEST-QueryEqualityTest.testFuncDoubleValueBools-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncDoubleValueBools
   [junit4] OK      0.00s J1 | QueryEqualityTest.testFuncDoubleValueBools
   [junit4]   2> 9456 INFO  (TEST-QueryEqualityTest.testChildField-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testChildField
   [junit4]   2> 9456 INFO  (TEST-QueryEqualityTest.testChildField-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testChildField
   [junit4] OK      0.00s J1 | QueryEqualityTest.testChildField
   [junit4]   2> 9458 INFO  (TEST-QueryEqualityTest.testQueryJoin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryJoin
   [junit4]   2> 9458 INFO  (TEST-QueryEqualityTest.testQueryJoin-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryJoin
   [junit4] OK      0.00s J1 | QueryEqualityTest.testQueryJoin
   [junit4]   2> 9459 INFO  (TEST-QueryEqualityTest.testFuncIf-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncIf
   [junit4]   2> 9460 INFO  (TEST-QueryEqualityTest.testFuncIf-seed#[AB4A85D3378889D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncIf
   [junit4] OK      0.00s J1 | QueryEqualityTest.testFuncIf
   [junit4]   2> 9460 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 9460 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1939728473
   [junit4]   2> 9461 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 9461 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2e7ebc47: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@76de693
   [junit4]   2> 9467 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 9467 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@482869a0: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1e5b8b90
   [junit4]   2> 9467 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 9467 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@79797739: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@ed168c
   [junit4]   2> 9468 INFO  (coreCloseExecutor-31-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1c8c3d30
   [junit4]   2> 9469 INFO  (coreCloseExecutor-31-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1c8c3d30
   [junit4]   2> 9469 INFO  (coreCloseExecutor-31-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@d3b5ea9: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@a3fc3a6
   [junit4]   2> 9487 INFO  (SUITE-QueryEqualityTest-seed#[AB4A85D3378889D0]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Lucene80, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4d9ea0c8), locale=ja-JP, timezone=America/Menominee
   [junit4]   2> NOTE: Linux 4.15.0-36-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=8,threads=1,free=357867152,total=515899392
   [junit4]   2> NOTE: All tests run in this JVM: [QueryEqualityTest, QueryEqualityTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=QueryEqualityTest -Dtests.seed=AB4A85D3378889D0 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=ja-JP -Dtests.timezone=America/Menominee -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | QueryEqualityTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([AB4A85D3378889D0]:0)
   [junit4]    > 	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [5/5 (5!)] on J1 in 1.27s, 91 tests, 1 failure <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: AB4A85D3378889D0]:
   [junit4]   - org.apache.solr.search.QueryEqualityTest (suite)
   [junit4]   - org.apache.solr.search.QueryEqualityTest (suite)
   [junit4]   - org.apache.solr.search.QueryEqualityTest (suite)
   [junit4]   - org.apache.solr.search.QueryEqualityTest (suite)
   [junit4]   - org.apache.solr.search.QueryEqualityTest (suite)
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.44 ..     9.99 =     9.55s
   [junit4] JVM J1:     0.44 ..    10.19 =     9.75s
   [junit4] JVM J2:     0.45 ..     8.61 =     8.16s
   [junit4] Execution time total: 10 seconds
   [junit4] Tests summary: 5 suites, 455 tests, 5 suite-level errors

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 5 suites, 455 tests, 5 suite-level errors [seed: AB4A85D3378889D0]

Total time: 11 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.search.QueryEqualityTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=3e87499d72131f2ee54b03fa83ed177413fd3cbc, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23088
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.4) - Build # 23088 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23088/
Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseSerialGC

11 tests failed.
FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:46617/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:46617/solr
	at __randomizedtesting.SeedInfo.seed([49E73E48B4A22477:881747E499F2EED0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:32879/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:32879/solr
	at __randomizedtesting.SeedInfo.seed([49E73E48B4A22477:881747E499F2EED0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:36927/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:36927/solr
	at __randomizedtesting.SeedInfo.seed([49E73E48B4A22477:881747E499F2EED0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:39651/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:39651/solr
	at __randomizedtesting.SeedInfo.seed([49E73E48B4A22477:881747E499F2EED0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:41407/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:41407/solr
	at __randomizedtesting.SeedInfo.seed([49E73E48B4A22477:881747E499F2EED0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([49E73E48B4A22477]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([49E73E48B4A22477]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([49E73E48B4A22477]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([49E73E48B4A22477]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([49E73E48B4A22477]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: min_hash

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
	at __randomizedtesting.SeedInfo.seed([49E73E48B4A22477]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 14295 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestTlogReplica
   [junit4]   2> 1555446 INFO  (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_49E73E48B4A22477-001/init-core-data-001
   [junit4]   2> 1555447 WARN  (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=14 numCloses=14
   [junit4]   2> 1555447 INFO  (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1555447 INFO  (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 1555448 INFO  (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_49E73E48B4A22477-001/tempDir-001
   [junit4]   2> 1555448 INFO  (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1555449 INFO  (Thread-2872) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1555449 INFO  (Thread-2872) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1555452 ERROR (Thread-2872) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1555549 INFO  (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:46423
   [junit4]   2> 1555550 INFO  (zkConnectionManagerCallback-4172-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1555553 INFO  (jetty-launcher-4169-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9.0.4+11
   [junit4]   2> 1555553 INFO  (jetty-launcher-4169-thread-2) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9.0.4+11
   [junit4]   2> 1555554 INFO  (jetty-launcher-4169-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1555554 INFO  (jetty-launcher-4169-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1555554 INFO  (jetty-launcher-4169-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1555554 INFO  (jetty-launcher-4169-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1555554 INFO  (jetty-launcher-4169-thread-2) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1555554 INFO  (jetty-launcher-4169-thread-1) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1555554 INFO  (jetty-launcher-4169-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@344d2492{/solr,null,AVAILABLE}
   [junit4]   2> 1555554 INFO  (jetty-launcher-4169-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5ce90b63{/solr,null,AVAILABLE}
   [junit4]   2> 1555555 INFO  (jetty-launcher-4169-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4dc7034b{SSL,[ssl, http/1.1]}{127.0.0.1:۴۴۹۴۳}
   [junit4]   2> 1555555 INFO  (jetty-launcher-4169-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@63a76b58{SSL,[ssl, http/1.1]}{127.0.0.1:۴۱۴۰۷}
   [junit4]   2> 1555555 INFO  (jetty-launcher-4169-thread-1) [    ] o.e.j.s.Server Started @۱۵۵۵۵۹۴ms
   [junit4]   2> 1555555 INFO  (jetty-launcher-4169-thread-2) [    ] o.e.j.s.Server Started @۱۵۵۵۵۹۴ms
   [junit4]   2> 1555555 INFO  (jetty-launcher-4169-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44943}
   [junit4]   2> 1555555 INFO  (jetty-launcher-4169-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41407}
   [junit4]   2> 1555555 ERROR (jetty-launcher-4169-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1555555 INFO  (jetty-launcher-4169-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1555555 ERROR (jetty-launcher-4169-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1555555 INFO  (jetty-launcher-4169-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1555555 INFO  (jetty-launcher-4169-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 1555556 INFO  (jetty-launcher-4169-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1555556 INFO  (jetty-launcher-4169-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 1555556 INFO  (jetty-launcher-4169-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1555556 INFO  (jetty-launcher-4169-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-10-25T00:22:42.267035Z
   [junit4]   2> 1555556 INFO  (jetty-launcher-4169-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1555556 INFO  (jetty-launcher-4169-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1555556 INFO  (jetty-launcher-4169-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-10-25T00:22:42.267082Z
   [junit4]   2> 1555565 INFO  (zkConnectionManagerCallback-4174-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1555565 INFO  (zkConnectionManagerCallback-4176-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1555565 INFO  (jetty-launcher-4169-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1555565 INFO  (jetty-launcher-4169-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1555568 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10057c4dd540001, likely client has closed socket
   [junit4]   2> 1555629 INFO  (jetty-launcher-4169-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46423/solr
   [junit4]   2> 1555630 INFO  (zkConnectionManagerCallback-4180-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1555632 INFO  (zkConnectionManagerCallback-4182-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1555633 INFO  (jetty-launcher-4169-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46423/solr
   [junit4]   2> 1555634 INFO  (zkConnectionManagerCallback-4186-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1555635 INFO  (zkConnectionManagerCallback-4188-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1555672 INFO  (jetty-launcher-4169-thread-1) [n:127.0.0.1:44943_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44943_solr
   [junit4]   2> 1555672 INFO  (jetty-launcher-4169-thread-2) [n:127.0.0.1:41407_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41407_solr
   [junit4]   2> 1555672 INFO  (jetty-launcher-4169-thread-1) [n:127.0.0.1:44943_solr    ] o.a.s.c.Overseer Overseer (id=72154097076404230-127.0.0.1:44943_solr-n_0000000000) starting
   [junit4]   2> 1555673 INFO  (zkCallback-4187-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1555673 INFO  (zkCallback-4181-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1555676 INFO  (zkConnectionManagerCallback-4197-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1555676 INFO  (jetty-launcher-4169-thread-1) [n:127.0.0.1:44943_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1555677 INFO  (jetty-launcher-4169-thread-1) [n:127.0.0.1:44943_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46423/solr ready
   [junit4]   2> 1555677 INFO  (OverseerStateUpdate-72154097076404230-127.0.0.1:44943_solr-n_0000000000) [n:127.0.0.1:44943_solr    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44943_solr
   [junit4]   2> 1555678 INFO  (jetty-launcher-4169-thread-1) [n:127.0.0.1:44943_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1555678 INFO  (jetty-launcher-4169-thread-1) [n:127.0.0.1:44943_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44943_solr
   [junit4]   2> 1555682 INFO  (zkCallback-4187-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1555683 INFO  (zkCallback-4196-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1555685 INFO  (zkCallback-4181-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1555686 INFO  (zkConnectionManagerCallback-4202-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1555686 INFO  (jetty-launcher-4169-thread-2) [n:127.0.0.1:41407_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1555690 INFO  (jetty-launcher-4169-thread-2) [n:127.0.0.1:41407_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46423/solr ready
   [junit4]   2> 1555690 INFO  (jetty-launcher-4169-thread-2) [n:127.0.0.1:41407_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1555691 INFO  (jetty-launcher-4169-thread-1) [n:127.0.0.1:44943_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1555703 INFO  (jetty-launcher-4169-thread-2) [n:127.0.0.1:41407_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41407.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32d05d97
   [junit4]   2> 1555707 INFO  (jetty-launcher-4169-thread-1) [n:127.0.0.1:44943_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44943.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32d05d97
   [junit4]   2> 1555711 INFO  (jetty-launcher-4169-thread-2) [n:127.0.0.1:41407_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41407.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32d05d97
   [junit4]   2> 1555712 INFO  (jetty-launcher-4169-thread-2) [n:127.0.0.1:41407_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41407.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32d05d97
   [junit4]   2> 1555712 INFO  (jetty-launcher-4169-thread-2) [n:127.0.0.1:41407_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_49E73E48B4A22477-001/tempDir-001/node2/.
   [junit4]   2> 1555714 INFO  (jetty-launcher-4169-thread-1) [n:127.0.0.1:44943_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44943.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32d05d97
   [junit4]   2> 1555714 INFO  (jetty-launcher-4169-thread-1) [n:127.0.0.1:44943_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44943.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32d05d97
   [junit4]   2> 1555714 INFO  (jetty-launcher-4169-thread-1) [n:127.0.0.1:44943_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_49E73E48B4A22477-001/tempDir-001/node1/.
   [junit4]   2> 1555759 INFO  (zkConnectionManagerCallback-4206-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1555761 INFO  (zkConnectionManagerCallback-4211-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1555761 INFO  (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1555762 INFO  (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46423/solr ready
   [junit4]   2> 1555764 INFO  (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.s.c.TestTlogReplica Using legacyCloud?: false
   [junit4]   2> 1555784 INFO  (qtp2058215998-14601) [n:127.0.0.1:44943_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1555785 INFO  (qtp2058215998-14601) [n:127.0.0.1:44943_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=0
   [junit4] IGNOR/A 0.00s J2 | TestTlogReplica.testCreateDelete {seed=[49E73E48B4A22477:52F7CF044252DC47]}
   [junit4]    > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028"))
   [junit4] IGNOR/A 0.00s J2 | TestTlogReplica.testCreateDelete {seed=[49E73E48B4A22477:E6A173F87690176B]}
   [junit4]    > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028"))
   [junit4]   2> 1555811 INFO  (TEST-TestTlogReplica.testKillTlogReplica-seed#[49E73E48B4A22477]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testKillTlogReplica
   [junit4]   2> 1555813 INFO  (qtp2058215998-14597) [n:127.0.0.1:44943_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_kill_tlog_replica&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1555814 INFO  (OverseerThreadFactory-6174-thread-1-processing-n:127.0.0.1:44943_solr) [n:127.0.0.1:44943_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection tlog_replica_test_kill_tlog_replica
   [junit4]   2> 1555922 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1555932 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1555939 INFO  (OverseerStateUpdate-72154097076404230-127.0.0.1:44943_solr-n_0000000000) [n:127.0.0.1:44943_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"tlog_replica_test_kill_tlog_replica",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"tlog_replica_test_kill_tlog_replica_shard1_replica_t1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41407/solr",
   [junit4]   2>   "type":"TLOG",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1555941 INFO  (OverseerStateUpdate-72154097076404230-127.0.0.1:44943_solr-n_0000000000) [n:127.0.0.1:44943_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"tlog_replica_test_kill_tlog_replica",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"tlog_replica_test_kill_tlog_replica_shard1_replica_t2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44943/solr",
   [junit4]   2>   "type":"TLOG",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1556145 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr    x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_tlog_replica_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_kill_tlog_replica&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 1556145 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr    x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_tlog_replica_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_kill_tlog_replica&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 1556145 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr    x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1557152 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1557152 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1557156 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.s.IndexSchema [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] Schema name=minimal
   [junit4]   2> 1557156 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.s.IndexSchema [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] Schema name=minimal
   [junit4]   2> 1557157 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1557157 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_kill_tlog_replica_shard1_replica_t2' using configuration from collection tlog_replica_test_kill_tlog_replica, trusted=true
   [junit4]   2> 1557157 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1557157 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_kill_tlog_replica_shard1_replica_t1' using configuration from collection tlog_replica_test_kill_tlog_replica, trusted=true
   [junit4]   2> 1557157 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44943.solr.core.tlog_replica_test_kill_tlog_replica.shard1.replica_t2' (registry 'solr.core.tlog_replica_test_kill_tlog_replica.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32d05d97
   [junit4]   2> 1557157 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41407.solr.core.tlog_replica_test_kill_tlog_replica.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_kill_tlog_replica.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32d05d97
   [junit4]   2> 1557157 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.SolrCore [[tlog_replica_test_kill_tlog_replica_shard1_replica_t2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_49E73E48B4A22477-001/tempDir-001/node1/tlog_replica_test_kill_tlog_replica_shard1_replica_t2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_49E73E48B4A22477-001/tempDir-001/node1/./tlog_replica_test_kill_tlog_replica_shard1_replica_t2/data/]
   [junit4]   2> 1557157 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.SolrCore [[tlog_replica_test_kill_tlog_replica_shard1_replica_t1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_49E73E48B4A22477-001/tempDir-001/node2/tlog_replica_test_kill_tlog_replica_shard1_replica_t1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_49E73E48B4A22477-001/tempDir-001/node2/./tlog_replica_test_kill_tlog_replica_shard1_replica_t1/data/]
   [junit4]   2> 1557192 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1557192 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1557192 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1557192 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1557193 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.s.SolrIndexSearcher Opening [Searcher@45b28508[tlog_replica_test_kill_tlog_replica_shard1_replica_t2] main]
   [junit4]   2> 1557193 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1557194 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1557194 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1557194 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1615254744103649280
   [junit4]   2> 1557194 INFO  (searcherExecutor-6183-thread-1-processing-n:127.0.0.1:44943_solr x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2 c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.SolrCore [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] Registered new searcher Searcher@45b28508[tlog_replica_test_kill_tlog_replica_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1557197 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_kill_tlog_replica/terms/shard1 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 1557198 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1557201 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1557201 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1557202 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1557202 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1557203 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.s.SolrIndexSearcher Opening [Searcher@667da39e[tlog_replica_test_kill_tlog_replica_shard1_replica_t1] main]
   [junit4]   2> 1557204 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1557204 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1557204 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1557204 INFO  (searcherExecutor-6184-thread-1-processing-n:127.0.0.1:41407_solr x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1 c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.SolrCore [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] Registered new searcher Searcher@667da39e[tlog_replica_test_kill_tlog_replica_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1557204 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1615254744114135040
   [junit4]   2> 1557207 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_kill_tlog_replica/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 1557699 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1557699 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1557699 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44943/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/
   [junit4]   2> 1557699 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_kill_tlog_replica_shard1_replica_t2 url=https://127.0.0.1:44943/solr START replicas=[https://127.0.0.1:41407/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t1/] nUpdates=100
   [junit4]   2> 1557700 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_kill_tlog_replica_shard1_replica_t2 url=https://127.0.0.1:44943/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 1557701 INFO  (qtp1638437644-14600) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1557702 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1557702 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1557702 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.ZkController tlog_replica_test_kill_tlog_replica_shard1_replica_t2 stopping background replication from leader
   [junit4]   2> 1557703 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44943/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/ shard1
   [junit4]   2> 1557855 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1557856 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_tlog_replica_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_kill_tlog_replica&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1711
   [junit4]   2> 1557956 INFO  (zkCallback-4187-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1558208 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.ZkController tlog_replica_test_kill_tlog_replica_shard1_replica_t1 starting background replication from leader
   [junit4]   2> 1558208 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 1558209 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 1558209 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1558214 INFO  (indexFetcher-6194-thread-1) [    ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:44943/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/
   [junit4]   2> 1558215 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_tlog_replica_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_kill_tlog_replica&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2070
   [junit4]   2> 1558216 INFO  (qtp2058215998-14587) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1558216 INFO  (indexFetcher-6194-thread-1) [    ] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1558216 INFO  (indexFetcher-6194-thread-1) [    ] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1558216 INFO  (indexFetcher-6194-thread-1) [    ] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 1558216 INFO  (indexFetcher-6194-thread-1) [    ] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 1558222 INFO  (indexFetcher-6194-thread-1) [    ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 1558228 INFO  (qtp2058215998-14597) [n:127.0.0.1:44943_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1558229 INFO  (indexFetcher-6194-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3e8cc96a[tlog_replica_test_kill_tlog_replica_shard1_replica_t1] main]
   [junit4]   2> 1558230 INFO  (searcherExecutor-6184-thread-1) [    ] o.a.s.c.SolrCore [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] Registered new searcher Searcher@3e8cc96a[tlog_replica_test_kill_tlog_replica_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1558315 INFO  (zkCallback-4181-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1558315 INFO  (zkCallback-4187-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1559228 INFO  (qtp2058215998-14597) [n:127.0.0.1:44943_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_kill_tlog_replica&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2} status=0 QTime=3415
   [junit4]   2> 1559234 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1559237 INFO  (qtp2058215998-14597) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1559246 INFO  (qtp2058215998-14601) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_kill_tlog_replica/terms/shard1 to Terms{values={core_node3=1, core_node4=1}, version=2}
   [junit4]   2> 1559248 INFO  (qtp1638437644-14598) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:44943/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/&wt=javabin&version=2}{add=[1 (1615254746247987200)]} 0 0
   [junit4]   2> 1559248 INFO  (qtp2058215998-14601) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_tlog_replica_shard1_replica_t2]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1615254746247987200)]} 0 9
   [junit4]   2> 1559255 INFO  (qtp1638437644-14669) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:44943/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
   [junit4]   2> 1559256 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1615254746265812992,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1559256 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@4b3129a9 commitCommandVersion:1615254746265812992
   [junit4]   2> 1559262 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.s.SolrIndexSearcher Opening [Searcher@3545fae1[tlog_replica_test_kill_tlog_replica_shard1_replica_t2] main]
   [junit4]   2> 1559262 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1559263 INFO  (searcherExecutor-6183-thread-1-processing-n:127.0.0.1:44943_solr x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2 c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.c.SolrCore [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] Registered new searcher Searcher@3545fae1[tlog_replica_test_kill_tlog_replica_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
   [junit4]   2> 1559264 INFO  (qtp2058215998-14664) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_tlog_replica_shard1_replica_t2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:44943/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 7
   [junit4]   2> 1559264 INFO  (qtp2058215998-14597) [n:127.0.0.1:44943_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node4 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_tlog_replica_shard1_replica_t2]  webapp=/solr path=/update params={_stateVer_=tlog_replica_test_kill_tlog_replica:6&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 14
   [junit4]   2> 1559272 INFO  (qtp1638437644-14669) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1559373 INFO  (qtp1638437644-14590) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1559474 INFO  (qtp1638437644-14669) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1559574 INFO  (qtp1638437644-14590) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1559675 INFO  (qtp1638437644-14669) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1559776 INFO  (qtp1638437644-14590) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1559823 INFO  (OverseerCollectionConfigSetProcessor-72154097076404230-127.0.0.1:44943_solr-n_0000000000) [n:127.0.0.1:44943_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1559877 INFO  (qtp1638437644-14669) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1559978 INFO  (qtp1638437644-14590) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1560079 INFO  (qtp1638437644-14669) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1560180 INFO  (qtp1638437644-14590) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1560280 INFO  (qtp1638437644-14669) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1560381 INFO  (qtp1638437644-14590) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1560482 INFO  (qtp1638437644-14669) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1560583 INFO  (qtp1638437644-14590) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1560683 INFO  (qtp1638437644-14669) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1560784 INFO  (qtp1638437644-14590) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1560885 INFO  (qtp1638437644-14669) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1560986 INFO  (qtp1638437644-14590) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1561087 INFO  (qtp1638437644-14669) [n:127.0.0.1:41407_solr c:tlog_replica_test_kill_tlog_replica s:shard1 r:core_node3 x:tlog_replica_test_kill_tlog_replica_shard1_replica_t1] o.a.s.c.S.Request [tlog_repli

[...truncated too long message...]

solr.cluster, tag=null
   [junit4]   2> 220290 INFO  (zkCallback-244-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
   [junit4]   2> 220291 INFO  (zkCallback-254-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
   [junit4]   2> 220291 INFO  (zkCallback-261-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
   [junit4]   2> 220291 INFO  (zkCallback-237-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
   [junit4]   2> 220292 INFO  (jetty-closer-134-thread-2) [    ] o.a.s.c.Overseer Overseer (id=72154219516592153-127.0.0.1:46641_solr-n_0000000005) closing
   [junit4]   2> 220292 INFO  (OverseerStateUpdate-72154219516592153-127.0.0.1:46641_solr-n_0000000005) [n:127.0.0.1:46641_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:46641_solr
   [junit4]   2> 220293 WARN  (OverseerAutoScalingTriggerThread-72154219516592153-127.0.0.1:46641_solr-n_0000000005) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 220297 INFO  (jetty-closer-134-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@642e6776{/solr,null,UNAVAILABLE}
   [junit4]   2> 220297 INFO  (zkCallback-254-thread-1) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36927_solr
   [junit4]   2> 220297 INFO  (jetty-closer-134-thread-2) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 227839 ERROR (recoveryExecutor-251-thread-1-processing-n:127.0.0.1:36927_solr x:tlog_replica_test_recovery_shard1_replica_t2 c:tlog_replica_test_recovery s:shard1 r:core_node4) [n:127.0.0.1:36927_solr c:tlog_replica_test_recovery s:shard1 r:core_node4 x:tlog_replica_test_recovery_shard1_replica_t2] o.a.s.c.RecoveryStrategy SolrCore not found - cannot recover:tlog_replica_test_recovery_shard1_replica_t2
   [junit4]   2> 227842 INFO  (jetty-closer-134-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@f35ea0f{/solr,null,UNAVAILABLE}
   [junit4]   2> 227842 INFO  (jetty-closer-134-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 227843 ERROR (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 227843 INFO  (SUITE-TestTlogReplica-seed#[49E73E48B4A22477]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36777 36777
   [junit4]   2> 227844 INFO  (Thread-101) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36777 36777
   [junit4]   2> 227844 WARN  (Thread-101) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	32	/solr/configs/conf
   [junit4]   2> 	30	/solr/collections/tlog_replica_test_create_delete/terms/shard2
   [junit4]   2> 	30	/solr/collections/tlog_replica_test_create_delete/terms/shard1
   [junit4]   2> 	19	/solr/collections/tlog_replica_test_recovery/terms/shard1
   [junit4]   2> 	18	/solr/collections/tlog_replica_test_remove_leader/terms/shard1
   [junit4]   2> 	16	/solr/collections/tlog_replica_test_basic_leader_election/terms/shard1
   [junit4]   2> 	16	/solr/collections/tlog_replica_test_kill_leader/terms/shard1
   [junit4]   2> 	16	/solr/collections/tlog_replica_test_kill_tlog_replica/terms/shard1
   [junit4]   2> 	15	/solr/aliases.json
   [junit4]   2> 	15	/solr/collections/tlog_replica_test_real_time_get/terms/shard1
   [junit4]   2> 	10	/solr/collections/tlog_replica_test_add_docs/terms/shard1
   [junit4]   2> 	10	/solr/collections/tlog_replica_test_delete_by_id/terms/shard1
   [junit4]   2> 	9	/solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/terms/shard1
   [junit4]   2> 	9	/solr/collections/tlog_replica_test_only_leader_indexes/terms/shard1
   [junit4]   2> 	7	/solr/security.json
   [junit4]   2> 	6	/solr/collections/tlog_replica_test_add_remove_tlog_replica/terms/shard2
   [junit4]   2> 	5	/solr/collections/tlog_replica_test_add_remove_tlog_replica/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	23	/solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json
   [junit4]   2> 	17	/solr/collections/tlog_replica_test_create_delete/state.json
   [junit4]   2> 	15	/solr/clusterstate.json
   [junit4]   2> 	15	/solr/clusterprops.json
   [junit4]   2> 	9	/solr/collections/tlog_replica_test_remove_leader/state.json
   [junit4]   2> 	8	/solr/collections/tlog_replica_test_kill_leader/state.json
   [junit4]   2> 	8	/solr/collections/tlog_replica_test_recovery/state.json
   [junit4]   2> 	7	/solr/collections/tlog_replica_test_kill_tlog_replica/state.json
   [junit4]   2> 	7	/solr/collections/tlog_replica_test_basic_leader_election/state.json
   [junit4]   2> 	5	/solr/autoscaling.json
   [junit4]   2> 	5	/solr/collections/tlog_replica_test_real_time_get/state.json
   [junit4]   2> 	3	/solr/collections/tlog_replica_test_add_docs/state.json
   [junit4]   2> 	3	/solr/collections/tlog_replica_test_add_remove_tlog_replica/state.json
   [junit4]   2> 	3	/solr/collections/tlog_replica_test_only_leader_indexes/state.json
   [junit4]   2> 	3	/solr/collections/tlog_replica_test_delete_by_id/state.json
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/72154219516592132-core_node12-n_0000000000
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/72154219516592134-core_node16-n_0000000001
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_recovery/leader_elect/shard1/election/72154219516592153-core_node3-n_0000000000
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/72154219516592134-core_node9-n_0000000001
   [junit4]   2> 	2	/solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/72154219516592132-core_node13-n_0000000001
   [junit4]   2> 	2	/solr/overseer_elect/election/72154219516592145-127.0.0.1:36927_solr-n_0000000003
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	15	/solr/live_nodes
   [junit4]   2> 	15	/solr/collections
   [junit4]   2> 	5	/solr/overseer/queue
   [junit4]   2> 	5	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	5	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	5	/solr/overseer/queue-work
   [junit4]   2> 	5	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_49E73E48B4A22477-002
   [junit4]   2> Oct 25, 2018 12:55:39 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): {foo=FSTOrd50, title_s=PostingsFormat(name=Asserting), id=PostingsFormat(name=Direct), foo_s=FSTOrd50}, docValues:{_version_=DocValuesFormat(name=Asserting), id=DocValuesFormat(name=Lucene70), inplace_updatable_int=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=908, maxMBSortInHeap=5.454962922495779, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@28cdfd3a), locale=rof-TZ, timezone=Africa/Kigali
   [junit4]   2> NOTE: Linux 4.15.0-36-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=193245008,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestTlogReplica, TestTlogReplica]
   [junit4] Completed [10/10 (10!)] on J0 in 109.56s, 13 tests, 1 failure <<< FAILURES!

[...truncated 20 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 10 suites, 520 tests, 5 suite-level errors, 5 failures [seed: 49E73E48B4A22477]

Total time: 3 minutes 50 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.cloud.TestTlogReplica
[repro]   5/5 failed: org.apache.solr.search.QueryEqualityTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=71988c756b76a96cb96fc8f86183219a4a008389, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23087
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-11) - Build # 23087 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23087/
Java: 64bit/jdk-11 -XX:-UseCompressedOops -XX:+UseG1GC

30 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCloudRecovery

Error Message:
Could not find collection:collection1

Stack Trace:
java.lang.AssertionError: Could not find collection:collection1
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.TestCloudRecovery.setupCluster(TestCloudRecovery.java:70)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCloudRecovery

Error Message:
Could not find collection:collection1

Stack Trace:
java.lang.AssertionError: Could not find collection:collection1
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.TestCloudRecovery.setupCluster(TestCloudRecovery.java:70)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCloudRecovery

Error Message:
Could not find collection:collection1

Stack Trace:
java.lang.AssertionError: Could not find collection:collection1
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.TestCloudRecovery.setupCluster(TestCloudRecovery.java:70)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCloudRecovery

Error Message:
Could not find collection:collection1

Stack Trace:
java.lang.AssertionError: Could not find collection:collection1
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.TestCloudRecovery.setupCluster(TestCloudRecovery.java:70)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCloudRecovery

Error Message:
Could not find collection:collection1

Stack Trace:
java.lang.AssertionError: Could not find collection:collection1
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.TestCloudRecovery.setupCluster(TestCloudRecovery.java:70)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCloudRecovery

Error Message:
Could not find collection:collection1

Stack Trace:
java.lang.AssertionError: Could not find collection:collection1
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.cloud.TestCloudRecovery.setupCluster(TestCloudRecovery.java:70)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Error from server at https://127.0.0.1:36401/solr: Could not restore core

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:36401/solr: Could not restore core
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:194E383D222E4C30]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:313)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
	at org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test(TestLocalFSCloudBackupRestore.java:64)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Error from server at https://127.0.0.1:43111/solr: Could not restore core

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:43111/solr: Could not restore core
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:194E383D222E4C30]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:313)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
	at org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test(TestLocalFSCloudBackupRestore.java:64)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Node 127.0.0.1:42225_solr has 3 replicas. Expected num replicas : 2. state:  DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/7)={   "pullReplicas":0,   "replicationFactor":1,   "shards":{     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{"core_node62":{           "core":"backuprestore_restored_shard2_replica_n61",           "base_url":"https://127.0.0.1:42225/solr",           "node_name":"127.0.0.1:42225_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415372949810325"},     "shard1_1":{       "range":"c0000000-ffffffff",       "state":"active",       "replicas":{"core_node64":{           "core":"backuprestore_restored_shard1_1_replica_n63",           "base_url":"https://127.0.0.1:42225/solr",           "node_name":"127.0.0.1:42225_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415372949841777"},     "shard1_0":{       "range":"80000000-bfffffff",       "state":"active",       "replicas":{"core_node66":{           "core":"backuprestore_restored_shard1_0_replica_n65",           "base_url":"https://127.0.0.1:42225/solr",           "node_name":"127.0.0.1:42225_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415372949864671"}},   "router":{     "name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:42225_solr has 3 replicas. Expected num replicas : 2. state: 
DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/7)={
  "pullReplicas":0,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{"core_node62":{
          "core":"backuprestore_restored_shard2_replica_n61",
          "base_url":"https://127.0.0.1:42225/solr",
          "node_name":"127.0.0.1:42225_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415372949810325"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{"core_node64":{
          "core":"backuprestore_restored_shard1_1_replica_n63",
          "base_url":"https://127.0.0.1:42225/solr",
          "node_name":"127.0.0.1:42225_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415372949841777"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{"core_node66":{
          "core":"backuprestore_restored_shard1_0_replica_n65",
          "base_url":"https://127.0.0.1:42225/solr",
          "node_name":"127.0.0.1:42225_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415372949864671"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:194E383D222E4C30]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
	at java.base/java.util.HashMap.forEach(HashMap.java:1336)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
	at org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test(TestLocalFSCloudBackupRestore.java:64)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Node 127.0.0.1:43313_solr has 3 replicas. Expected num replicas : 2. state:  DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/8)={   "pullReplicas":0,   "replicationFactor":1,   "shards":{     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{"core_node62":{           "core":"backuprestore_restored_shard2_replica_n61",           "base_url":"https://127.0.0.1:43313/solr",           "node_name":"127.0.0.1:43313_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415377584605146"},     "shard1_1":{       "range":"c0000000-ffffffff",       "state":"active",       "replicas":{"core_node64":{           "core":"backuprestore_restored_shard1_1_replica_n63",           "base_url":"https://127.0.0.1:43313/solr",           "node_name":"127.0.0.1:43313_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415377584651191"},     "shard1_0":{       "range":"80000000-bfffffff",       "state":"active",       "replicas":{"core_node66":{           "core":"backuprestore_restored_shard1_0_replica_n65",           "base_url":"https://127.0.0.1:43313/solr",           "node_name":"127.0.0.1:43313_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415377584671502"}},   "router":{     "name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:43313_solr has 3 replicas. Expected num replicas : 2. state: 
DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/8)={
  "pullReplicas":0,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{"core_node62":{
          "core":"backuprestore_restored_shard2_replica_n61",
          "base_url":"https://127.0.0.1:43313/solr",
          "node_name":"127.0.0.1:43313_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415377584605146"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{"core_node64":{
          "core":"backuprestore_restored_shard1_1_replica_n63",
          "base_url":"https://127.0.0.1:43313/solr",
          "node_name":"127.0.0.1:43313_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415377584651191"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{"core_node66":{
          "core":"backuprestore_restored_shard1_0_replica_n65",
          "base_url":"https://127.0.0.1:43313/solr",
          "node_name":"127.0.0.1:43313_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415377584671502"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:194E383D222E4C30]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
	at java.base/java.util.HashMap.forEach(HashMap.java:1336)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
	at org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test(TestLocalFSCloudBackupRestore.java:64)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Node 127.0.0.1:35645_solr has 3 replicas. Expected num replicas : 2. state:  DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/10)={   "pullReplicas":0,   "replicationFactor":1,   "shards":{     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{"core_node62":{           "core":"backuprestore_restored_shard2_replica_n61",           "base_url":"https://127.0.0.1:35645/solr",           "node_name":"127.0.0.1:35645_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415083221009048"},     "shard1_1":{       "range":"c0000000-ffffffff",       "state":"active",       "replicas":{"core_node64":{           "core":"backuprestore_restored_shard1_1_replica_n63",           "base_url":"https://127.0.0.1:35645/solr",           "node_name":"127.0.0.1:35645_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415083221071948"},     "shard1_0":{       "range":"80000000-bfffffff",       "state":"active",       "replicas":{"core_node66":{           "core":"backuprestore_restored_shard1_0_replica_n65",           "base_url":"https://127.0.0.1:35645/solr",           "node_name":"127.0.0.1:35645_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415083221139012"}},   "router":{     "name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:35645_solr has 3 replicas. Expected num replicas : 2. state: 
DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/10)={
  "pullReplicas":0,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{"core_node62":{
          "core":"backuprestore_restored_shard2_replica_n61",
          "base_url":"https://127.0.0.1:35645/solr",
          "node_name":"127.0.0.1:35645_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415083221009048"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{"core_node64":{
          "core":"backuprestore_restored_shard1_1_replica_n63",
          "base_url":"https://127.0.0.1:35645/solr",
          "node_name":"127.0.0.1:35645_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415083221071948"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{"core_node66":{
          "core":"backuprestore_restored_shard1_0_replica_n65",
          "base_url":"https://127.0.0.1:35645/solr",
          "node_name":"127.0.0.1:35645_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415083221139012"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:194E383D222E4C30]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
	at java.base/java.util.HashMap.forEach(HashMap.java:1336)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
	at org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test(TestLocalFSCloudBackupRestore.java:64)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Node 127.0.0.1:39529_solr has 3 replicas. Expected num replicas : 2. state:  DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/10)={   "pullReplicas":0,   "replicationFactor":1,   "shards":{     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{"core_node62":{           "core":"backuprestore_restored_shard2_replica_n61",           "base_url":"https://127.0.0.1:39529/solr",           "node_name":"127.0.0.1:39529_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540412142326672245"},     "shard1_1":{       "range":"c0000000-ffffffff",       "state":"active",       "replicas":{"core_node64":{           "core":"backuprestore_restored_shard1_1_replica_n63",           "base_url":"https://127.0.0.1:39529/solr",           "node_name":"127.0.0.1:39529_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540412142326705111"},     "shard1_0":{       "range":"80000000-bfffffff",       "state":"active",       "replicas":{"core_node66":{           "core":"backuprestore_restored_shard1_0_replica_n65",           "base_url":"https://127.0.0.1:39529/solr",           "node_name":"127.0.0.1:39529_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540412142326725296"}},   "router":{     "name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:39529_solr has 3 replicas. Expected num replicas : 2. state: 
DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/10)={
  "pullReplicas":0,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{"core_node62":{
          "core":"backuprestore_restored_shard2_replica_n61",
          "base_url":"https://127.0.0.1:39529/solr",
          "node_name":"127.0.0.1:39529_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540412142326672245"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{"core_node64":{
          "core":"backuprestore_restored_shard1_1_replica_n63",
          "base_url":"https://127.0.0.1:39529/solr",
          "node_name":"127.0.0.1:39529_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540412142326705111"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{"core_node66":{
          "core":"backuprestore_restored_shard1_0_replica_n65",
          "base_url":"https://127.0.0.1:39529/solr",
          "node_name":"127.0.0.1:39529_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540412142326725296"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:194E383D222E4C30]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
	at java.base/java.util.HashMap.forEach(HashMap.java:1336)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
	at org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test(TestLocalFSCloudBackupRestore.java:64)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:37589/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:37589/solr
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:50EA7E4BA182EB6F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:34903/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:34903/solr
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:50EA7E4BA182EB6F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:35637/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:35637/solr
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:50EA7E4BA182EB6F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:46713/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:46713/solr
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:50EA7E4BA182EB6F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:39021/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:39021/solr
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:50EA7E4BA182EB6F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:37591/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:37591/solr
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:50EA7E4BA182EB6F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:44295_solr has 3 replicas. Expected num replicas : 2. state:  DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/10)={   "pullReplicas":0,   "replicationFactor":1,   "shards":{     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{"core_node62":{           "core":"hdfsbackuprestore_restored_shard2_replica_n61",           "base_url":"https://127.0.0.1:44295/solr",           "node_name":"127.0.0.1:44295_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415229110221169"},     "shard1_1":{       "range":"c0000000-ffffffff",       "state":"active",       "replicas":{"core_node64":{           "core":"hdfsbackuprestore_restored_shard1_1_replica_n63",           "base_url":"https://127.0.0.1:44295/solr",           "node_name":"127.0.0.1:44295_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415229110255993"},     "shard1_0":{       "range":"80000000-bfffffff",       "state":"active",       "replicas":{"core_node66":{           "core":"hdfsbackuprestore_restored_shard1_0_replica_n65",           "base_url":"https://127.0.0.1:44295/solr",           "node_name":"127.0.0.1:44295_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}},       "stateTimestamp":"1540415229110274493"}},   "router":{     "name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:44295_solr has 3 replicas. Expected num replicas : 2. state: 
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/10)={
  "pullReplicas":0,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{"core_node62":{
          "core":"hdfsbackuprestore_restored_shard2_replica_n61",
          "base_url":"https://127.0.0.1:44295/solr",
          "node_name":"127.0.0.1:44295_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415229110221169"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{"core_node64":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_n63",
          "base_url":"https://127.0.0.1:44295/solr",
          "node_name":"127.0.0.1:44295_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415229110255993"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{"core_node66":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_n65",
          "base_url":"https://127.0.0.1:44295/solr",
          "node_name":"127.0.0.1:44295_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}},
      "stateTimestamp":"1540415229110274493"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
	at __randomizedtesting.SeedInfo.seed([911A07E78CD221C8:194E383D222E4C30]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.as

[...truncated too long message...]

.collection.backuprestore.shard1_0.leader, tag=5e0be301
   [junit4]   2> 315372 INFO  (coreCloseExecutor-1211-thread-3) [n:127.0.0.1:39547_solr c:backuprestore s:shard1_1 r:core_node8 x:backuprestore_shard1_1_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.backuprestore.shard1_1.replica_n6, tag=48988de4
   [junit4]   2> 315372 INFO  (coreCloseExecutor-1211-thread-3) [n:127.0.0.1:39547_solr c:backuprestore s:shard1_1 r:core_node8 x:backuprestore_shard1_1_replica_n6] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6fa90f01: rootName = solr_39547, domain = solr.core.backuprestore.shard1_1.replica_n6, service url = null, agent id = null] for registry solr.core.backuprestore.shard1_1.replica_n6 / com.codahale.metrics.MetricRegistry@553d9b7f
   [junit4]   2> 315380 INFO  (coreCloseExecutor-1212-thread-2) [n:127.0.0.1:43313_solr c:backuprestore_restored s:shard2 r:core_node62 x:backuprestore_restored_shard2_replica_n61] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.backuprestore_restored.shard2.leader, tag=42cd4d21
   [junit4]   2> 315380 INFO  (coreCloseExecutor-1212-thread-3) [n:127.0.0.1:43313_solr c:backuprestore_restored s:shard1_1 r:core_node64 x:backuprestore_restored_shard1_1_replica_n63] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.backuprestore_restored.shard1_1.replica_n63, tag=41358aac
   [junit4]   2> 315380 INFO  (coreCloseExecutor-1212-thread-3) [n:127.0.0.1:43313_solr c:backuprestore_restored s:shard1_1 r:core_node64 x:backuprestore_restored_shard1_1_replica_n63] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@35f9d8c4: rootName = solr_43313, domain = solr.core.backuprestore_restored.shard1_1.replica_n63, service url = null, agent id = null] for registry solr.core.backuprestore_restored.shard1_1.replica_n63 / com.codahale.metrics.MetricRegistry@41ff45e0
   [junit4]   2> 315383 INFO  (coreCloseExecutor-1211-thread-3) [n:127.0.0.1:39547_solr c:backuprestore s:shard1_1 r:core_node8 x:backuprestore_shard1_1_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.backuprestore.shard1_1.leader, tag=48988de4
   [junit4]   2> 315389 INFO  (jetty-closer-397-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7baeef6e{/solr,null,UNAVAILABLE}
   [junit4]   2> 315389 INFO  (jetty-closer-397-thread-2) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 315392 INFO  (coreCloseExecutor-1212-thread-3) [n:127.0.0.1:43313_solr c:backuprestore_restored s:shard1_1 r:core_node64 x:backuprestore_restored_shard1_1_replica_n63] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.backuprestore_restored.shard1_1.leader, tag=41358aac
   [junit4]   2> 315392 INFO  (coreCloseExecutor-1212-thread-4) [n:127.0.0.1:43313_solr c:backuprestore_restored s:shard1_0 r:core_node66 x:backuprestore_restored_shard1_0_replica_n65] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.backuprestore_restored.shard1_0.replica_n65, tag=3cdf3b07
   [junit4]   2> 315392 INFO  (coreCloseExecutor-1212-thread-4) [n:127.0.0.1:43313_solr c:backuprestore_restored s:shard1_0 r:core_node66 x:backuprestore_restored_shard1_0_replica_n65] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@58d2e04a: rootName = solr_43313, domain = solr.core.backuprestore_restored.shard1_0.replica_n65, service url = null, agent id = null] for registry solr.core.backuprestore_restored.shard1_0.replica_n65 / com.codahale.metrics.MetricRegistry@31186013
   [junit4]   2> 315404 INFO  (coreCloseExecutor-1212-thread-4) [n:127.0.0.1:43313_solr c:backuprestore_restored s:shard1_0 r:core_node66 x:backuprestore_restored_shard1_0_replica_n65] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.backuprestore_restored.shard1_0.leader, tag=3cdf3b07
   [junit4]   2> 315406 INFO  (jetty-closer-397-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72153337194414084-127.0.0.1:43313_solr-n_0000000000) closing
   [junit4]   2> 315406 INFO  (OverseerStateUpdate-72153337194414084-127.0.0.1:43313_solr-n_0000000000) [n:127.0.0.1:43313_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43313_solr
   [junit4]   2> 315406 WARN  (OverseerAutoScalingTriggerThread-72153337194414084-127.0.0.1:43313_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 315411 INFO  (jetty-closer-397-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@246c8e28{/solr,null,UNAVAILABLE}
   [junit4]   2> 315411 INFO  (jetty-closer-397-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 315411 ERROR (SUITE-TestLocalFSCloudBackupRestore-seed#[911A07E78CD221C8]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 315412 INFO  (SUITE-TestLocalFSCloudBackupRestore-seed#[911A07E78CD221C8]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39789 39789
   [junit4]   2> 315524 INFO  (Thread-770) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39789 39789
   [junit4]   2> 315524 WARN  (Thread-770) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	3	/solr/collections/backuprestore/terms/shard1_0
   [junit4]   2> 	3	/solr/collections/backuprestore_restored/terms/shard1_0
   [junit4]   2> 	3	/solr/collections/backuprestore_restored/terms/shard1_1
   [junit4]   2> 	3	/solr/collections/backuprestore/terms/shard1_1
   [junit4]   2> 	3	/solr/collections/backuprestore/terms/shard2
   [junit4]   2> 	3	/solr/collections/backuprestore_restored/terms/shard2
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 	2	/solr/configs/conf1
   [junit4]   2> 	2	/solr/collections/backuprestore/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/collections/backuprestore_restored/state.json
   [junit4]   2> 	2	/solr/collections/backuprestore/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/live_nodes
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.TestLocalFSCloudBackupRestore_911A07E78CD221C8-001
   [junit4]   2> Oct 24, 2018 9:09:38 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@f673e58), locale=pl-PL, timezone=SystemV/MST7MDT
   [junit4]   2> NOTE: Linux 4.15.0-36-generic amd64/Oracle Corporation 11 (64-bit)/cpus=8,threads=1,free=273359352,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [QueryEqualityTest, TestTlogReplica, TestCloudRecovery, TestHdfsCloudBackupRestore, TestTlogReplica, TestHdfsCloudBackupRestore, TestLocalFSCloudBackupRestore]
   [junit4] Completed [25/25 (25!)] on J1 in 12.53s, 1 test, 1 failure <<< FAILURES!

[...truncated 20 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 25 suites, 530 tests, 10 suite-level errors, 2 errors, 13 failures [seed: 911A07E78CD221C8]

Total time: 5 minutes 19 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.cloud.TestCloudRecovery
[repro]   5/5 failed: org.apache.solr.cloud.TestTlogReplica
[repro]   5/5 failed: org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore
[repro]   5/5 failed: org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore
[repro]   5/5 failed: org.apache.solr.search.QueryEqualityTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=e62fe459834a287cccf01f25ec03b8764f7a5af7, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23086
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_172) - Build # 23086 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23086/
Java: 32bit/jdk1.8.0_172 -server -XX:+UseParallelGC

16 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicZkTest

Error Message:
SolrCore.getOpenCount()==2

Stack Trace:
java.lang.RuntimeException: SolrCore.getOpenCount()==2
	at __randomizedtesting.SeedInfo.seed([250E9960E0FE53A4]:0)
	at org.apache.solr.util.TestHarness.close(TestHarness.java:380)
	at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:802)
	at org.apache.solr.cloud.AbstractZkTestCase.azt_afterClass(AbstractZkTestCase.java:147)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicZkTest

Error Message:
SolrCore.getOpenCount()==2

Stack Trace:
java.lang.RuntimeException: SolrCore.getOpenCount()==2
	at __randomizedtesting.SeedInfo.seed([250E9960E0FE53A4]:0)
	at org.apache.solr.util.TestHarness.close(TestHarness.java:380)
	at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:802)
	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:297)
	at sun.reflect.GeneratedMethodAccessor37.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicZkTest

Error Message:
25 threads leaked from SUITE scope at org.apache.solr.cloud.BasicZkTest:     1) Thread[id=7253, name=Thread-1825, state=WAITING, group=TGRP-BasicZkTest]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:502)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1857)    2) Thread[id=7235, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-SendThread(127.0.0.1:38789), state=RUNNABLE, group=TGRP-BasicZkTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)    3) Thread[id=7240, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-EventThread, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)    4) Thread[id=7247, name=ScheduledTrigger-3179-thread-2, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    5) Thread[id=7267, name=ProcessThread(sid:0 cport:38789):, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)    6) Thread[id=7263, name=Thread-1826, state=WAITING, group=TGRP-BasicZkTest]         at java.lang.Object.wait(Native Method)         at java.lang.Thread.join(Thread.java:1252)         at java.lang.Thread.join(Thread.java:1326)         at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)         at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)         at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496)    7) Thread[id=7243, name=OverseerAutoScalingTriggerThread-72152412385640451-88.99.242.108:8983_-n_0000000000, state=WAITING, group=Overseer autoscaling triggers]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:189)         at java.lang.Thread.run(Thread.java:748)    8) Thread[id=7251, name=MetricsHistoryHandler-3184-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    9) Thread[id=7236, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-EventThread, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   10) Thread[id=7269, name=SolrRrdBackendFactory-3183-thread-2, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   11) Thread[id=7248, name=ScheduledTrigger-3179-thread-3, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   12) Thread[id=7246, name=ScheduledTrigger-3179-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   13) Thread[id=7264, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:38789, state=RUNNABLE, group=TGRP-BasicZkTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)         at java.lang.Thread.run(Thread.java:748)   14) Thread[id=7237, name=zkConnectionManagerCallback-1715-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   15) Thread[id=7230, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   16) Thread[id=7241, name=zkConnectionManagerCallback-1722-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   17) Thread[id=7229, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   18) Thread[id=7239, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-SendThread(127.0.0.1:38789), state=RUNNABLE, group=TGRP-BasicZkTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)   19) Thread[id=7249, name=ScheduledTrigger-3179-thread-4, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   20) Thread[id=7238, name=OverseerStateUpdate-72152412385640451-88.99.242.108:8983_-n_0000000000, state=TIMED_WAITING, group=Overseer state updater.]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)         at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:207)         at java.lang.Thread.run(Thread.java:748)   21) Thread[id=7250, name=SolrRrdBackendFactory-3183-thread-1, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   22) Thread[id=7242, name=OverseerCollectionConfigSetProcessor-72152412385640451-88.99.242.108:8983_-n_0000000000, state=TIMED_WAITING, group=Overseer collection creation process.]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)         at org.apache.solr.cloud.OverseerTaskQueue.peekTopN(OverseerTaskQueue.java:243)         at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:233)         at java.lang.Thread.run(Thread.java:748)   23) Thread[id=7255, name=searcherExecutor-3186-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   24) Thread[id=7265, name=SessionTracker, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Object.wait(Native Method)         at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147)   25) Thread[id=7231, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 25 threads leaked from SUITE scope at org.apache.solr.cloud.BasicZkTest: 
   1) Thread[id=7253, name=Thread-1825, state=WAITING, group=TGRP-BasicZkTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at org.apache.solr.core.CloserThread.run(CoreContainer.java:1857)
   2) Thread[id=7235, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-SendThread(127.0.0.1:38789), state=RUNNABLE, group=TGRP-BasicZkTest]
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   3) Thread[id=7240, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-EventThread, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   4) Thread[id=7247, name=ScheduledTrigger-3179-thread-2, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   5) Thread[id=7267, name=ProcessThread(sid:0 cport:38789):, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)
   6) Thread[id=7263, name=Thread-1826, state=WAITING, group=TGRP-BasicZkTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1252)
        at java.lang.Thread.join(Thread.java:1326)
        at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)
        at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)
        at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496)
   7) Thread[id=7243, name=OverseerAutoScalingTriggerThread-72152412385640451-88.99.242.108:8983_-n_0000000000, state=WAITING, group=Overseer autoscaling triggers]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:189)
        at java.lang.Thread.run(Thread.java:748)
   8) Thread[id=7251, name=MetricsHistoryHandler-3184-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   9) Thread[id=7236, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-EventThread, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
  10) Thread[id=7269, name=SolrRrdBackendFactory-3183-thread-2, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  11) Thread[id=7248, name=ScheduledTrigger-3179-thread-3, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  12) Thread[id=7246, name=ScheduledTrigger-3179-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  13) Thread[id=7264, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:38789, state=RUNNABLE, group=TGRP-BasicZkTest]
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
        at java.lang.Thread.run(Thread.java:748)
  14) Thread[id=7237, name=zkConnectionManagerCallback-1715-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  15) Thread[id=7230, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
  16) Thread[id=7241, name=zkConnectionManagerCallback-1722-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  17) Thread[id=7229, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
  18) Thread[id=7239, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-SendThread(127.0.0.1:38789), state=RUNNABLE, group=TGRP-BasicZkTest]
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
  19) Thread[id=7249, name=ScheduledTrigger-3179-thread-4, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  20) Thread[id=7238, name=OverseerStateUpdate-72152412385640451-88.99.242.108:8983_-n_0000000000, state=TIMED_WAITING, group=Overseer state updater.]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)
        at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:207)
        at java.lang.Thread.run(Thread.java:748)
  21) Thread[id=7250, name=SolrRrdBackendFactory-3183-thread-1, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  22) Thread[id=7242, name=OverseerCollectionConfigSetProcessor-72152412385640451-88.99.242.108:8983_-n_0000000000, state=TIMED_WAITING, group=Overseer collection creation process.]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)
        at org.apache.solr.cloud.OverseerTaskQueue.peekTopN(OverseerTaskQueue.java:243)
        at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:233)
        at java.lang.Thread.run(Thread.java:748)
  23) Thread[id=7255, name=searcherExecutor-3186-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  24) Thread[id=7265, name=SessionTracker, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Object.wait(Native Method)
        at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147)
  25) Thread[id=7231, name=Connection evictor, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([250E9960E0FE53A4]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=7253, name=Thread-1825, state=WAITING, group=TGRP-BasicZkTest]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:502)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1857)    2) Thread[id=7237, name=zkConnectionManagerCallback-1715-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    3) Thread[id=7235, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-SendThread(127.0.0.1:38789), state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)    4) Thread[id=7247, name=ScheduledTrigger-3179-thread-2, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    5) Thread[id=7241, name=zkConnectionManagerCallback-1722-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    6) Thread[id=7239, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-SendThread(127.0.0.1:38789), state=TIMED_WAITING, group=TGRP-BasicZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)    7) Thread[id=7251, name=MetricsHistoryHandler-3184-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    8) Thread[id=7249, name=ScheduledTrigger-3179-thread-4, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    9) Thread[id=7269, name=SolrRrdBackendFactory-3183-thread-2, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   10) Thread[id=7250, name=SolrRrdBackendFactory-3183-thread-1, state=TIMED_WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   11) Thread[id=7248, name=ScheduledTrigger-3179-thread-3, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   12) Thread[id=7246, name=ScheduledTrigger-3179-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   13) Thread[id=7255, name=searcherExecutor-3186-thread-1, state=WAITING, group=TGRP-BasicZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=7253, name=Thread-1825, state=WAITING, group=TGRP-BasicZkTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at org.apache.solr.core.CloserThread.run(CoreContainer.java:1857)
   2) Thread[id=7237, name=zkConnectionManagerCallback-1715-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   3) Thread[id=7235, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-SendThread(127.0.0.1:38789), state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
   4) Thread[id=7247, name=ScheduledTrigger-3179-thread-2, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   5) Thread[id=7241, name=zkConnectionManagerCallback-1722-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   6) Thread[id=7239, name=SUITE-BasicZkTest-seed#[250E9960E0FE53A4]-worker-SendThread(127.0.0.1:38789), state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
   7) Thread[id=7251, name=MetricsHistoryHandler-3184-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   8) Thread[id=7249, name=ScheduledTrigger-3179-thread-4, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   9) Thread[id=7269, name=SolrRrdBackendFactory-3183-thread-2, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  10) Thread[id=7250, name=SolrRrdBackendFactory-3183-thread-1, state=TIMED_WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  11) Thread[id=7248, name=ScheduledTrigger-3179-thread-3, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  12) Thread[id=7246, name=ScheduledTrigger-3179-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  13) Thread[id=7255, name=searcherExecutor-3186-thread-1, state=WAITING, group=TGRP-BasicZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([250E9960E0FE53A4]:0)


FAILED:  org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica

Error Message:
Expected new active leader null Live Nodes: [127.0.0.1:33085_solr, 127.0.0.1:35741_solr, 127.0.0.1:36689_solr] Last available state: DocCollection(raceDeleteReplica_true//collections/raceDeleteReplica_true/state.json/11)={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"raceDeleteReplica_true_shard1_replica_n1",           "base_url":"https://127.0.0.1:40729/solr",           "node_name":"127.0.0.1:40729_solr",           "state":"down",           "type":"NRT",           "leader":"true"},         "core_node6":{           "core":"raceDeleteReplica_true_shard1_replica_n5",           "base_url":"https://127.0.0.1:40729/solr",           "node_name":"127.0.0.1:40729_solr",           "state":"down",           "type":"NRT"},         "core_node4":{           "core":"raceDeleteReplica_true_shard1_replica_n2",           "base_url":"https://127.0.0.1:33085/solr",           "node_name":"127.0.0.1:33085_solr",           "state":"down",           "type":"NRT"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"1",   "autoAddReplicas":"false",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Expected new active leader
null
Live Nodes: [127.0.0.1:33085_solr, 127.0.0.1:35741_solr, 127.0.0.1:36689_solr]
Last available state: DocCollection(raceDeleteReplica_true//collections/raceDeleteReplica_true/state.json/11)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"raceDeleteReplica_true_shard1_replica_n1",
          "base_url":"https://127.0.0.1:40729/solr",
          "node_name":"127.0.0.1:40729_solr",
          "state":"down",
          "type":"NRT",
          "leader":"true"},
        "core_node6":{
          "core":"raceDeleteReplica_true_shard1_replica_n5",
          "base_url":"https://127.0.0.1:40729/solr",
          "node_name":"127.0.0.1:40729_solr",
          "state":"down",
          "type":"NRT"},
        "core_node4":{
          "core":"raceDeleteReplica_true_shard1_replica_n2",
          "base_url":"https://127.0.0.1:33085/solr",
          "node_name":"127.0.0.1:33085_solr",
          "state":"down",
          "type":"NRT"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([250E9960E0FE53A4:4F18F8B0880C196E]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:280)
	at org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:328)
	at org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:223)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest

Error Message:
Error from server at https://127.0.0.1:33085/solr: Cannot create collection delLiveColl. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:33085/solr: Cannot create collection delLiveColl. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)
	at __randomizedtesting.SeedInfo.seed([250E9960E0FE53A4:886E2D6BFDC1FBD1]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:73)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards

Error Message:
Error from server at https://127.0.0.1:33085/solr: Cannot create collection deleteByCountNew. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:33085/solr: Cannot create collection deleteByCountNew. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)
	at __randomizedtesting.SeedInfo.seed([250E9960E0FE53A4:199FDE34AFBF0EF1]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards(DeleteReplicaTest.java:161)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica

Error Message:
Expected new active leader null Live Nodes: [127.0.0.1:34811_solr, 127.0.0.1:37359_solr, 127.0.0.1:41693_solr] Last available state: DocCollection(raceDeleteReplica_true//collections/raceDeleteReplica_true/state.json/12)={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"raceDeleteReplica_true_shard1_replica_n1",           "base_url":"https://127.0.0.1:41755/solr",           "node_name":"127.0.0.1:41755_solr",           "state":"down",           "type":"NRT",           "leader":"true"},         "core_node6":{           "core":"raceDeleteReplica_true_shard1_replica_n5",           "base_url":"https://127.0.0.1:41755/solr",           "node_name":"127.0.0.1:41755_solr",           "state":"down",           "type":"NRT"},         "core_node4":{           "core":"raceDeleteReplica_true_shard1_replica_n2",           "base_url":"https://127.0.0.1:37359/solr",           "node_name":"127.0.0.1:37359_solr",           "state":"down",           "type":"NRT"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"1",   "autoAddReplicas":"false",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Expected new active leader
null
Live Nodes: [127.0.0.1:34811_solr, 127.0.0.1:37359_solr, 127.0.0.1:41693_solr]
Last available state: DocCollection(raceDeleteReplica_true//collections/raceDeleteReplica_true/state.json/12)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"raceDeleteReplica_true_shard1_replica_n1",
          "base_url":"https://127.0.0.1:41755/solr",
          "node_name":"127.0.0.1:41755_solr",
          "state":"down",
          "type":"NRT",
          "leader":"true"},
        "core_node6":{
          "core":"raceDeleteReplica_true_shard1_replica_n5",
          "base_url":"https://127.0.0.1:41755/solr",
          "node_name":"127.0.0.1:41755_solr",
          "state":"down",
          "type":"NRT"},
        "core_node4":{
          "core":"raceDeleteReplica_true_shard1_replica_n2",
          "base_url":"https://127.0.0.1:37359/solr",
          "node_name":"127.0.0.1:37359_solr",
          "state":"down",
          "type":"NRT"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([250E9960E0FE53A4:4F18F8B0880C196E]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:280)
	at org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:328)
	at org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:223)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest

Error Message:
Error from server at https://127.0.0.1:37359/solr: Cannot create collection delLiveColl. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37359/solr: Cannot create collection delLiveColl. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)
	at __randomizedtesting.SeedInfo.seed([250E9960E0FE53A4:886E2D6BFDC1FBD1]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:73)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards

Error Message:
Error from server at https://127.0.0.1:37359/solr: Cannot create collection deleteByCountNew. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37359/solr: Cannot create collection deleteByCountNew. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)
	at __randomizedtesting.SeedInfo.seed([250E9960E0FE53A4:199FDE34AFBF0EF1]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendReq

[...truncated too long message...]

ityTest.testPayloadCheckQuery-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testPayloadCheckQuery
   [junit4]   2> 160572 INFO  (TEST-QueryEqualityTest.testPayloadCheckQuery-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testPayloadCheckQuery
   [junit4] OK      0.00s J2 | QueryEqualityTest.testPayloadCheckQuery
   [junit4]   2> 160574 INFO  (TEST-QueryEqualityTest.testQueryScoreJoin-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testQueryScoreJoin
   [junit4]   2> 160574 INFO  (TEST-QueryEqualityTest.testQueryScoreJoin-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testQueryScoreJoin
   [junit4] OK      0.00s J2 | QueryEqualityTest.testQueryScoreJoin
   [junit4]   2> 160576 INFO  (TEST-QueryEqualityTest.testFuncProduct-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncProduct
   [junit4]   2> 160576 INFO  (TEST-QueryEqualityTest.testFuncProduct-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncProduct
   [junit4] OK      0.00s J2 | QueryEqualityTest.testFuncProduct
   [junit4]   2> 160577 INFO  (TEST-QueryEqualityTest.testFuncRord-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncRord
   [junit4]   2> 160577 INFO  (TEST-QueryEqualityTest.testFuncRord-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncRord
   [junit4] OK      0.00s J2 | QueryEqualityTest.testFuncRord
   [junit4]   2> 160578 INFO  (TEST-QueryEqualityTest.testFuncVector-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncVector
   [junit4]   2> 160579 INFO  (TEST-QueryEqualityTest.testFuncVector-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncVector
   [junit4] OK      0.00s J2 | QueryEqualityTest.testFuncVector
   [junit4]   2> 160580 INFO  (TEST-QueryEqualityTest.testFuncMod-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncMod
   [junit4]   2> 160580 INFO  (TEST-QueryEqualityTest.testFuncMod-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncMod
   [junit4] OK      0.00s J2 | QueryEqualityTest.testFuncMod
   [junit4]   2> 160581 INFO  (TEST-QueryEqualityTest.testBoolQuery-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBoolQuery
   [junit4]   2> 160582 INFO  (TEST-QueryEqualityTest.testBoolQuery-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBoolQuery
   [junit4] OK      0.00s J2 | QueryEqualityTest.testBoolQuery
   [junit4]   2> 160583 INFO  (TEST-QueryEqualityTest.testFuncSum-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncSum
   [junit4]   2> 160583 INFO  (TEST-QueryEqualityTest.testFuncSum-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncSum
   [junit4] OK      0.00s J2 | QueryEqualityTest.testFuncSum
   [junit4]   2> 160584 INFO  (TEST-QueryEqualityTest.testFuncStrdist-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncStrdist
   [junit4]   2> 160584 INFO  (TEST-QueryEqualityTest.testFuncStrdist-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncStrdist
   [junit4] OK      0.00s J2 | QueryEqualityTest.testFuncStrdist
   [junit4]   2> 160586 INFO  (TEST-QueryEqualityTest.testFuncHsin-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFuncHsin
   [junit4]   2> 160586 INFO  (TEST-QueryEqualityTest.testFuncHsin-seed#[250E9960E0FE53A4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testFuncHsin
   [junit4] OK      0.00s J2 | QueryEqualityTest.testFuncHsin
   [junit4]   2> 160587 INFO  (SUITE-QueryEqualityTest-seed#[250E9960E0FE53A4]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 160587 INFO  (SUITE-QueryEqualityTest-seed#[250E9960E0FE53A4]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=33064230
   [junit4]   2> 160587 INFO  (SUITE-QueryEqualityTest-seed#[250E9960E0FE53A4]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 160587 INFO  (SUITE-QueryEqualityTest-seed#[250E9960E0FE53A4]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3771ff: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@10b6566
   [junit4]   2> 160590 INFO  (SUITE-QueryEqualityTest-seed#[250E9960E0FE53A4]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 160590 INFO  (SUITE-QueryEqualityTest-seed#[250E9960E0FE53A4]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1fcaac5: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@c6ea27
   [junit4]   2> 160592 INFO  (SUITE-QueryEqualityTest-seed#[250E9960E0FE53A4]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 160592 INFO  (SUITE-QueryEqualityTest-seed#[250E9960E0FE53A4]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@fbe275: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@b25843
   [junit4]   2> 160593 INFO  (coreCloseExecutor-277-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@67cfe6
   [junit4]   2> 160593 INFO  (coreCloseExecutor-277-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=67cfe6
   [junit4]   2> 160593 INFO  (coreCloseExecutor-277-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@160b379: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@1edd6ae
   [junit4]   2> 160602 INFO  (SUITE-QueryEqualityTest-seed#[250E9960E0FE53A4]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): {lowerfilt=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), id=Lucene50(blocksize=128)}, docValues:{_version_=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=2026, maxMBSortInHeap=5.959269777524174, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3b7b08), locale=zh, timezone=America/Grand_Turk
   [junit4]   2> NOTE: Linux 4.15.0-36-generic i386/Oracle Corporation 1.8.0_172 (32-bit)/cpus=8,threads=1,free=55578480,total=283639808
   [junit4]   2> NOTE: All tests run in this JVM: [BasicZkTest, DeleteReplicaTest, BasicZkTest, BasicZkTest, BasicZkTest, QueryEqualityTest, QueryEqualityTest, QueryEqualityTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=QueryEqualityTest -Dtests.seed=250E9960E0FE53A4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=zh -Dtests.timezone=America/Grand_Turk -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J2 | QueryEqualityTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: min_hash
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([250E9960E0FE53A4]:0)
   [junit4]    > 	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:59)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [13/15 (6!)] on J2 in 0.88s, 91 tests, 1 failure <<< FAILURES!

[...truncated 38 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 15 suites, 495 tests, 5 suite-level errors, 2 errors, 1 failure [seed: 250E9960E0FE53A4]

Total time: 2 minutes 56 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.BasicZkTest
[repro]   1/5 failed: org.apache.solr.cloud.DeleteReplicaTest
[repro]   5/5 failed: org.apache.solr.search.QueryEqualityTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=bd714ca1edc681cd871e6d385bd98a9cb9d7ffe6, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23085
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-12-ea+12) - Build # 23085 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23085/
Java: 64bit/jdk-12-ea+12 -XX:-UseCompressedOops -XX:+UseG1GC

59 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
20 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest:     1) Thread[id=2685, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)    2) Thread[id=2690, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    3) Thread[id=2683, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    4) Thread[id=2689, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    5) Thread[id=1569, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    6) Thread[id=1094, name=zkConnectionManagerCallback-436-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    7) Thread[id=1563, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    8) Thread[id=1565, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)    9) Thread[id=1098, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   10) Thread[id=1564, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)   11) Thread[id=1566, name=zkConnectionManagerCallback-682-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   12) Thread[id=1578, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   13) Thread[id=2684, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)   14) Thread[id=1097, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   15) Thread[id=1570, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   16) Thread[id=1092, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)   17) Thread[id=1093, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   18) Thread[id=1580, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   19) Thread[id=2686, name=zkConnectionManagerCallback-1230-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   20) Thread[id=1091, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 20 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest: 
   1) Thread[id=2685, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   2) Thread[id=2690, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   3) Thread[id=2683, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   4) Thread[id=2689, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   5) Thread[id=1569, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   6) Thread[id=1094, name=zkConnectionManagerCallback-436-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   7) Thread[id=1563, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   8) Thread[id=1565, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   9) Thread[id=1098, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  10) Thread[id=1564, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
  11) Thread[id=1566, name=zkConnectionManagerCallback-682-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  12) Thread[id=1578, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  13) Thread[id=2684, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
  14) Thread[id=1097, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  15) Thread[id=1570, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  16) Thread[id=1092, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
  17) Thread[id=1093, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
  18) Thread[id=1580, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  19) Thread[id=2686, name=zkConnectionManagerCallback-1230-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  20) Thread[id=1091, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
	at __randomizedtesting.SeedInfo.seed([87CBBC3A3DE81CB5]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=1566, name=zkConnectionManagerCallback-682-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    2) Thread[id=2684, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    3) Thread[id=1092, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    4) Thread[id=2686, name=zkConnectionManagerCallback-1230-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    5) Thread[id=1094, name=zkConnectionManagerCallback-436-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    6) Thread[id=1564, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=1566, name=zkConnectionManagerCallback-682-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   2) Thread[id=2684, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   3) Thread[id=1092, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   4) Thread[id=2686, name=zkConnectionManagerCallback-1230-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   5) Thread[id=1094, name=zkConnectionManagerCallback-436-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   6) Thread[id=1564, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:38743), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
	at __randomizedtesting.SeedInfo.seed([87CBBC3A3DE81CB5]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
14 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest:     1) Thread[id=1624, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    2) Thread[id=2736, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    3) Thread[id=2732, name=zkConnectionManagerCallback-1248-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    4) Thread[id=1627, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    5) Thread[id=1611, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)    6) Thread[id=1609, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    7) Thread[id=1612, name=zkConnectionManagerCallback-701-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    8) Thread[id=2729, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    9) Thread[id=2735, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   10) Thread[id=2730, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:42629), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)   11) Thread[id=2731, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   12) Thread[id=1610, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:42629), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)   13) Thread[id=1615, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   14) Thread[id=1616, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 14 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest: 
   1) Thread[id=1624, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   2) Thread[id=2736, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   3) Thread[id=2732, name=zkConnectionManagerCallback-1248-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   4) Thread[id=1627, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   5) Thread[id=1611, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   6) Thread[id=1609, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   7) Thread[id=1612, name=zkConnectionManagerCallback-701-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   8) Thread[id=2729, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   9) Thread[id=2735, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  10) Thread[id=2730, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:42629), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
  11) Thread[id=2731, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
  12) Thread[id=1610, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:42629), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
  13) Thread[id=1615, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  14) Thread[id=1616, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
	at __randomizedtesting.SeedInfo.seed([87CBBC3A3DE81CB5]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=2730, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:42629), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    2) Thread[id=2732, name=zkConnectionManagerCallback-1248-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    3) Thread[id=1610, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:42629), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)    4) Thread[id=1612, name=zkConnectionManagerCallback-701-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=2730, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:42629), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   2) Thread[id=2732, name=zkConnectionManagerCallback-1248-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   3) Thread[id=1610, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:42629), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
   4) Thread[id=1612, name=zkConnectionManagerCallback-701-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
	at __randomizedtesting.SeedInfo.seed([87CBBC3A3DE81CB5]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
20 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest:     1) Thread[id=632, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)    2) Thread[id=2231, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    3) Thread[id=1093, name=zkConnectionManagerCallback-551-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    4) Thread[id=637, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    5) Thread[id=1090, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    6) Thread[id=1108, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    7) Thread[id=2225, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    8) Thread[id=2228, name=zkConnectionManagerCallback-1105-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    9) Thread[id=2226, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)   10) Thread[id=633, name=zkConnectionManagerCallback-311-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   11) Thread[id=1092, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   12) Thread[id=1097, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   13) Thread[id=631, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)   14) Thread[id=2232, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   15) Thread[id=1107, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   16) Thread[id=630, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   17) Thread[id=1091, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)   18) Thread[id=1096, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   19) Thread[id=636, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   20) Thread[id=2227, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 20 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest: 
   1) Thread[id=632, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   2) Thread[id=2231, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   3) Thread[id=1093, name=zkConnectionManagerCallback-551-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   4) Thread[id=637, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   5) Thread[id=1090, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   6) Thread[id=1108, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   7) Thread[id=2225, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   8) Thread[id=2228, name=zkConnectionManagerCallback-1105-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   9) Thread[id=2226, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
  10) Thread[id=633, name=zkConnectionManagerCallback-311-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  11) Thread[id=1092, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
  12) Thread[id=1097, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  13) Thread[id=631, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
  14) Thread[id=2232, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  15) Thread[id=1107, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  16) Thread[id=630, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  17) Thread[id=1091, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
  18) Thread[id=1096, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  19) Thread[id=636, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  20) Thread[id=2227, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-EventThread, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
	at __randomizedtesting.SeedInfo.seed([87CBBC3A3DE81CB5]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamDecoratorTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=631, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)    2) Thread[id=1093, name=zkConnectionManagerCallback-551-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    3) Thread[id=1091, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    4) Thread[id=2228, name=zkConnectionManagerCallback-1105-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    5) Thread[id=2226, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)    6) Thread[id=633, name=zkConnectionManagerCallback-311-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=631, name=TEST-StreamDecoratorTest.testParallelHavingStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
   2) Thread[id=1093, name=zkConnectionManagerCallback-551-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   3) Thread[id=1091, name=TEST-StreamDecoratorTest.testExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   4) Thread[id=2228, name=zkConnectionManagerCallback-1105-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   5) Thread[id=2226, name=TEST-StreamDecoratorTest.testParallelExecutorStream-seed#[87CBBC3A3DE81CB5]-SendThread(127.0.0.1:39179), state=TIMED_WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
   6) Thread[id=633, name=zkConnectionManagerCallback-311-thread-1, state=WAITING, group=TGRP-StreamDecoratorTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@12-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
	at __randomizedtesting.SeedInfo.seed([87CBBC3A3DE81CB5]:0)


FAILED:  org.apache.solr.client.solrj.impl.CloudSolrClientTest.testAliasHandling

Error Message:
expected:<1> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
	at __randomizedtesting.SeedInfo.seed([87CBBC3A3DE81CB5:8234D3CAFEA61897]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testAliasHandling(CloudSolrClientTest.java:208)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:835)


FAILED:  org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelCommitStream

Error Message:
java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:36637/solr/collection1_shard2_replica_n2/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f,s_multi,i_multi&sort=a_f+asc,+a_i+asc&partitionKeys=a_f&distrib=false

Stack Trace:
java.io.IOException: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:36637/solr/collection1_shard2_replica_n2/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f,s_multi,i_multi&sort=a_f+asc,+a_i+asc&partitionKeys=a_f&distrib=false
	at __randomizedtesting.SeedInfo.seed([87CBBC3A3DE81CB5:A721DE3AA1A9F1F9]:0)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:400)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.open(CloudSolrStream.java:275)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.getTuples(StreamDecoratorTest.java:3954)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelCommitStream(StreamDecoratorTest.java:3019)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:835)
Caused by: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:36637/solr/collection1_shard2_replica_n2/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f,s_multi,i_multi&sort=a_f+asc,+a_i+asc&partitionKeys=a_f&distrib=false
	at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:394)
	... 41 more
Caused by: java.io.IOException: --> https://127.0.0.1:36637/solr/collection1_shard2_replica_n2/:java.util.concurrent.ExecutionException: java.io.IOException: params q=*:*&fl=id,a_s,a_i,a_f,s_multi,i_multi&sort=a_f+asc,+a_i+asc&partitionKeys=a_f&distrib=false
	at org.apache.solr.client.solrj.io.stream.SolrStream.read(SolrStream.java:215)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$TupleWrapper.next(CloudSolrStream.java:484)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:507)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:494)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more


FAILED:  org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelIntersectStream

Error Message:
java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:42881/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false

Stack Trace:
java.io.IOException: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:42881/solr/collection1_shard1_replica_n1/:java.util.concurrent.ExecutionException: java.io.IOException: params q=a_s:(setA+||+setAB)&fl=id,a_s,a_i&sort=a_i+asc,+a_s+asc&partitionKeys=a_i&distrib=false
	at __randomizedtesting.SeedInfo.seed([87CBBC3A3DE81CB5:90D3D70B545719C8]:0)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:400)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.open(CloudSolrStream.java:275)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.getTuples(StreamDecoratorTest.java:3954)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelIntersectStream(StreamDecoratorTest.java:3707)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at co

[...truncated too long message...]

olrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3ea0c258: rootName = solr_35397, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2a2778af
   [junit4]   2> 294151 INFO  (zkCallback-1015-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 294151 INFO  (zkCallback-1063-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 294151 INFO  (zkCallback-1049-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 294152 INFO  (jetty-closer-1000-thread-4) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:35397_solr
   [junit4]   2> 294152 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100558915030006, likely client has closed socket
   [junit4]   2> 294153 INFO  (zkCallback-1047-thread-3) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35397_solr
   [junit4]   2> 294153 INFO  (jetty-closer-1000-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@42b55307{/solr,null,UNAVAILABLE}
   [junit4]   2> 294153 INFO  (jetty-closer-1000-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 294153 INFO  (jetty-closer-1000-thread-4) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 294153 INFO  (zkCallback-1058-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 294154 INFO  (zkCallback-1047-thread-4) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 294154 INFO  (jetty-closer-1000-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@517e262a{/solr,null,UNAVAILABLE}
   [junit4]   2> 294154 INFO  (jetty-closer-1000-thread-3) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 294156 INFO  (jetty-closer-1000-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@67742c8c{/solr,null,UNAVAILABLE}
   [junit4]   2> 294156 INFO  (jetty-closer-1000-thread-4) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 294156 ERROR (SUITE-CustomCollectionTest-seed#[49A1203F3CB45A45]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 294156 INFO  (SUITE-CustomCollectionTest-seed#[49A1203F3CB45A45]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39781 39781
   [junit4]   2> 294274 INFO  (Thread-567) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39781 39781
   [junit4]   2> 294275 WARN  (Thread-567) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	32	/solr/collections/withShardField/terms/d
   [junit4]   2> 	29	/solr/collections/withShardField/terms/a
   [junit4]   2> 	26	/solr/collections/withShardField/terms/c
   [junit4]   2> 	24	/solr/collections/implicitcoll/terms/c
   [junit4]   2> 	19	/solr/collections/withShardField/terms/b
   [junit4]   2> 	15	/solr/configs/conf
   [junit4]   2> 	14	/solr/collections/implicitcoll/terms/b
   [junit4]   2> 	13	/solr/aliases.json
   [junit4]   2> 	10	/solr/collections/routeFieldColl/terms/shard4
   [junit4]   2> 	10	/solr/collections/routeFieldColl/terms/shard2
   [junit4]   2> 	10	/solr/collections/routeFieldColl/terms/shard3
   [junit4]   2> 	8	/solr/collections/routeFieldColl/terms/shard1
   [junit4]   2> 	8	/solr/collections/implicitcoll/terms/a
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	3	/solr/collections/testCreateShardRepFactor/terms/x
   [junit4]   2> 	3	/solr/collections/testCreateShardRepFactor/terms/a
   [junit4]   2> 	3	/solr/collections/testCreateShardRepFactor/terms/b
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	29	/solr/collections/withShardField/state.json
   [junit4]   2> 	13	/solr/clusterprops.json
   [junit4]   2> 	13	/solr/clusterstate.json
   [junit4]   2> 	12	/solr/collections/implicitcoll/state.json
   [junit4]   2> 	11	/solr/collections/routeFieldColl/state.json
   [junit4]   2> 	10	/solr/aliases.json
   [junit4]   2> 	5	/solr/collections/testCreateShardRepFactor/state.json
   [junit4]   2> 	3	/solr/collections/implicitcoll/leader_elect/c/election/72151641289326605-core_node23-n_0000000000
   [junit4]   2> 	2	/solr/collections/withShardField/leader_elect/b/election/72151641289326605-core_node13-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/72151641289326598-127.0.0.1:32771_solr-n_0000000000
   [junit4]   2> 	2	/solr/collections/withShardField/leader_elect/c/election/72151641289326598-core_node25-n_0000000002
   [junit4]   2> 	2	/solr/collections/withShardField/leader_elect/c/election/72151641289326606-core_node31-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	35	/solr/collections
   [junit4]   2> 	13	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.CustomCollectionTest_49A1203F3CB45A45-001
   [junit4]   2> Oct 24, 2018 1:59:46 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@421de45f), locale=ar-SY, timezone=America/St_Vincent
   [junit4]   2> NOTE: Linux 4.15.0-36-generic amd64/Oracle Corporation 12-ea (64-bit)/cpus=8,threads=1,free=356533056,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestMiniSolrCloudClusterSSL, TestMiniSolrCloudClusterSSL, QueryEqualityTest, QueryEqualityTest, TestUtilizeNode, CustomCollectionTest]
   [junit4] Completed [20/20 (15!)] on J1 in 97.05s, 4 tests, 2 errors <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 49A1203F3CB45A45] (first 10 out of 24):
   [junit4]   - org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth
   [junit4]   - org.apache.solr.search.QueryEqualityTest (suite)
   [junit4]   - org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslWithInvalidPeerName
   [junit4]   - org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslWithInvalidPeerName
   [junit4]   - org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName
   [junit4]   - org.apache.solr.cloud.TestUtilizeNode.test
   [junit4]   - org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName
   [junit4]   - org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth
   [junit4]   - org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName
   [junit4]   - org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.70 ..   289.27 =   288.57s
   [junit4] JVM J1:     0.70 ..   295.27 =   294.57s
   [junit4] JVM J2:     0.72 ..   247.42 =   246.71s
   [junit4] Execution time total: 4 minutes 55 seconds
   [junit4] Tests summary: 20 suites, 510 tests, 5 suite-level errors, 12 errors, 7 failures

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 20 suites, 510 tests, 5 suite-level errors, 12 errors, 7 failures [seed: 49A1203F3CB45A45]

Total time: 4 minutes 56 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   1/5 failed: org.apache.solr.client.solrj.impl.CloudSolrClientTest
[repro]   2/5 failed: org.apache.solr.cloud.TestUtilizeNode
[repro]   3/5 failed: org.apache.solr.client.solrj.io.stream.StreamDecoratorTest
[repro]   3/5 failed: org.apache.solr.cloud.api.collections.CustomCollectionTest
[repro]   5/5 failed: org.apache.solr.cloud.TestMiniSolrCloudClusterSSL
[repro]   5/5 failed: org.apache.solr.search.QueryEqualityTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=e083b1501ebe21abaf95bcd93f89af12142fd1ee, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23084
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2