You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/11/01 04:01:16 UTC

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20793 - Still Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20793/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:     1) Thread[id=469, name=jetty-launcher-64-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)    2) Thread[id=468, name=jetty-launcher-64-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   1) Thread[id=469, name=jetty-launcher-64-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   2) Thread[id=468, name=jetty-launcher-64-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
	at __randomizedtesting.SeedInfo.seed([38A6CE7C69683E4A]:0)


FAILED:  org.apache.solr.cloud.TestAuthenticationFramework.testBasics

Error Message:
Error from server at https://127.0.0.1:39501/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason: <pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:39501/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([38A6CE7C69683E4A:57E60505186603A]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:541)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1008)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
	at org.apache.solr.cloud.TestAuthenticationFramework.collectionCreateSearchDeleteTwice(TestAuthenticationFramework.java:126)
	at org.apache.solr.cloud.TestAuthenticationFramework.testBasics(TestAuthenticationFramework.java:74)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:39501/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:622)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:518)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more


FAILED:  org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple

Error Message:
Timeout waiting for all live and active

Stack Trace:
java.lang.AssertionError: Timeout waiting for all live and active
	at __randomizedtesting.SeedInfo.seed([38A6CE7C69683E4A:15EA824E9BEA9B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:91)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11605 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_38A6CE7C69683E4A-001/init-core-data-001
   [junit4]   2> 42686 WARN  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
   [junit4]   2> 42686 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 42688 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 42793 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 42833 WARN  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   2> 42913 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_38A6CE7C69683E4A-001/tempDir-001
   [junit4]   2> 42913 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 42915 INFO  (Thread-108) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 42915 INFO  (Thread-108) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 42918 ERROR (Thread-108) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 43015 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:42655
   [junit4]   2> 43027 INFO  (jetty-launcher-64-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 43028 INFO  (jetty-launcher-64-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3e8f754a{/solr,null,AVAILABLE}
   [junit4]   2> 43029 INFO  (jetty-launcher-64-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 43030 INFO  (jetty-launcher-64-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4f7bb8e5{/solr,null,AVAILABLE}
   [junit4]   2> 43043 INFO  (jetty-launcher-64-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@45c4352c{SSL,[ssl, http/1.1]}{127.0.0.1:39873}
   [junit4]   2> 43043 INFO  (jetty-launcher-64-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7dfe6449{SSL,[ssl, http/1.1]}{127.0.0.1:39993}
   [junit4]   2> 43043 INFO  (jetty-launcher-64-thread-1) [    ] o.e.j.s.Server Started @44381ms
   [junit4]   2> 43043 INFO  (jetty-launcher-64-thread-2) [    ] o.e.j.s.Server Started @44381ms
   [junit4]   2> 43043 INFO  (jetty-launcher-64-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39873}
   [junit4]   2> 43043 INFO  (jetty-launcher-64-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39993}
   [junit4]   2> 43044 ERROR (jetty-launcher-64-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 43044 ERROR (jetty-launcher-64-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 43044 INFO  (jetty-launcher-64-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 43044 INFO  (jetty-launcher-64-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 43044 INFO  (jetty-launcher-64-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 43044 INFO  (jetty-launcher-64-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 43044 INFO  (jetty-launcher-64-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 43044 INFO  (jetty-launcher-64-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 43044 INFO  (jetty-launcher-64-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T02:51:23.949Z
   [junit4]   2> 43044 INFO  (jetty-launcher-64-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T02:51:23.949Z
   [junit4]   2> 43047 INFO  (jetty-launcher-64-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 43047 INFO  (jetty-launcher-64-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 43055 INFO  (jetty-launcher-64-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42655/solr
   [junit4]   2> 43055 INFO  (jetty-launcher-64-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42655/solr
   [junit4]   2> 43075 INFO  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 43076 INFO  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39993_solr
   [junit4]   2> 43076 INFO  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.c.Overseer Overseer (id=98926898958958597-127.0.0.1:39993_solr-n_0000000000) starting
   [junit4]   2> 43080 INFO  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39993_solr
   [junit4]   2> 43082 INFO  (OverseerStateUpdate-98926898958958597-127.0.0.1:39993_solr-n_0000000000) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 43103 INFO  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 43106 WARN  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 43116 INFO  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
   [junit4]   2> 43134 INFO  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 43135 INFO  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 43136 INFO  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39873_solr
   [junit4]   2> 43137 INFO  (zkCallback-75-thread-1-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 43137 INFO  (zkCallback-76-thread-1-processing-n:127.0.0.1:39873_solr) [n:127.0.0.1:39873_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 43170 INFO  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 43170 WARN  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 43171 INFO  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
   [junit4]   2> 43209 INFO  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 43209 INFO  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 43247 INFO  (jetty-launcher-64-thread-2-EventThread) [n:127.0.0.1:39993_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 43247 INFO  (jetty-launcher-64-thread-1-EventThread) [n:127.0.0.1:39873_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 43375 WARN  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 43402 INFO  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39993.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2586827a
   [junit4]   2> 43409 INFO  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39993.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2586827a
   [junit4]   2> 43409 INFO  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39993.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2586827a
   [junit4]   2> 43411 INFO  (jetty-launcher-64-thread-2) [n:127.0.0.1:39993_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_38A6CE7C69683E4A-001/tempDir-001/node2/.
   [junit4]   2> 44267 WARN  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 44306 INFO  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39873.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2586827a
   [junit4]   2> 44312 INFO  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39873.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2586827a
   [junit4]   2> 44312 INFO  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39873.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2586827a
   [junit4]   2> 44313 INFO  (jetty-launcher-64-thread-1) [n:127.0.0.1:39873_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_38A6CE7C69683E4A-001/tempDir-001/node1/.
   [junit4]   2> 44342 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
   [junit4]   2> 50050 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=test&e=1509540685322&s=IPkgHqSNXNBAFxKKKqg5vMPb2/0="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:25 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:25 GMT
   [junit4]   2> 50050 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
   [junit4]   2> 50060 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
   [junit4]   2> 50069 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=test&e=1509540690966&s=P537EzOm2d1L6XDQKyWrvyQLFxQ="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:30 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:30 GMT
   [junit4]   2> 50069 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
   [junit4]   2> 50084 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
   [junit4]   2> 50091 INFO  (qtp367482667-425) [n:127.0.0.1:39993_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 50091 INFO  (qtp367482667-425) [n:127.0.0.1:39993_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 50092 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=test&e=1509540690990&s=KmHL9+pWw5cQUmQhaZQQJXhNXCA="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:30 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:30 GMT
   [junit4]   2> 50092 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
   [junit4]   2> 50103 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
   [junit4]   2> 50141 INFO  (qtp367482667-418) [n:127.0.0.1:39993_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 50141 INFO  (qtp367482667-418) [n:127.0.0.1:39993_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 50142 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=test&e=1509540691009&s=8ZvlqStZkaaHtJl2Th3tgc+kzgM="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:31 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:31 GMT
   [junit4]   2> 50142 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
   [junit4]   2> 50153 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
   [junit4]   2> 50158 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=test&e=1509540691059&s=ILYzqNwXkixFv3ONd26/b4Iyzsg="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:31 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:31 GMT
   [junit4]   2> 50158 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
   [junit4]   2> 50168 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
   [junit4]   2> 50172 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=test&e=1509540691074&s=Fywcwj+MR5yl1sODv/3UdUJCsfY="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:31 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:31 GMT
   [junit4]   2> 50172 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
   [junit4]   2> 50188 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
   [junit4]   2> 50386 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[38A6CE7C69683E4A]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 50386 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[38A6CE7C69683E4A]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42655/solr ready
   [junit4]   2> 50411 INFO  (qtp2095668191-428) [n:127.0.0.1:39873_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 50412 INFO  (OverseerThreadFactory-172-thread-1-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.CreateCollectionCmd Create collection forwardingCollection
   [junit4]   2> 50517 INFO  (OverseerStateUpdate-98926898958958597-127.0.0.1:39993_solr-n_0000000000) [n:127.0.0.1:39993_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"forwardingCollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"forwardingCollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39993/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 50738 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 50741 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 50858 INFO  (zkCallback-75-thread-1-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 50858 INFO  (zkCallback-75-thread-2-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 51779 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 51805 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
   [junit4]   2> 51935 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 51944 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
   [junit4]   2> 51945 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39993.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2586827a
   [junit4]   2> 51945 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 51945 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_38A6CE7C69683E4A-001/tempDir-001/node2/forwardingCollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_38A6CE7C69683E4A-001/tempDir-001/node2/./forwardingCollection_shard1_replica_n1/data/]
   [junit4]   2> 51947 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=45, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 52001 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 52001 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 52002 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 52002 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 52003 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3669593430410524]
   [junit4]   2> 52004 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@ab2de91[forwardingCollection_shard1_replica_n1] main]
   [junit4]   2> 52006 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 52031 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 52092 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 52092 INFO  (searcherExecutor-177-thread-1-processing-n:127.0.0.1:39993_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 52092 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582830392964022272
   [junit4]   2> 52092 INFO  (searcherExecutor-177-thread-1-processing-n:127.0.0.1:39993_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 52092 INFO  (searcherExecutor-177-thread-1-processing-n:127.0.0.1:39993_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 52092 INFO  (searcherExecutor-177-thread-1-processing-n:127.0.0.1:39993_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 52092 INFO  (searcherExecutor-177-thread-1-processing-n:127.0.0.1:39993_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 52093 INFO  (searcherExecutor-177-thread-1-processing-n:127.0.0.1:39993_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 52093 INFO  (searcherExecutor-177-thread-1-processing-n:127.0.0.1:39993_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 52093 INFO  (searcherExecutor-177-thread-1-processing-n:127.0.0.1:39993_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 52093 INFO  (searcherExecutor-177-thread-1-processing-n:127.0.0.1:39993_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 52094 INFO  (searcherExecutor-177-thread-1-processing-n:127.0.0.1:39993_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@ab2de91[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 52096 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 52096 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 52096 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:39993/solr/forwardingCollection_shard1_replica_n1/
   [junit4]   2> 52096 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 52096 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:39993/solr/forwardingCollection_shard1_replica_n1/ has no replicas
   [junit4]   2> 52096 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 52097 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:39993/solr/forwardingCollection_shard1_replica_n1/ shard1
   [junit4]   2> 52198 INFO  (zkCallback-75-thread-2-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 52198 INFO  (zkCallback-75-thread-3-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 52248 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 52249 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1511
   [junit4]   2> 52250 WARN  (httpShardExecutor-167-thread-1-processing-n:127.0.0.1:39993_solr [https:////127.0.0.1:39993//solr] https:////127.0.0.1:39993//solr) [n:127.0.0.1:39993_solr    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1509540691643&s=mD7A/588AS4wZxfFX43ZhmAzPn4="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:31 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:31 GMT
   [junit4]   2> 52257 INFO  (qtp2095668191-428) [n:127.0.0.1:39873_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 52351 INFO  (zkCallback-75-thread-2-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 52351 INFO  (zkCallback-75-thread-3-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 52415 INFO  (OverseerCollectionConfigSetProcessor-98926898958958597-127.0.0.1:39993_solr-n_0000000000) [n:127.0.0.1:39993_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 53257 INFO  (qtp2095668191-428) [n:127.0.0.1:39873_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=2846
   [junit4]   2> 53258 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1509540691316&s=VhjslcMJU+HrKT1UqJVs7k8Msmk="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:31 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:31 GMT
   [junit4]   2> 53258 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[38A6CE7C69683E4A]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
   [junit4]   2> 53258 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[38A6CE7C69683E4A]) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
   [junit4]   2> 53269 INFO  (qtp367482667-418) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=1
   [junit4]   2> 53270 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1509540694173&s=A6/kgJ9uRNW9QfZERudaSu/pKZY="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:34 GMT
   [junit4]   2> 53286 INFO  (qtp2095668191-427) [n:127.0.0.1:39873_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 53297 INFO  (qtp367482667-423) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 53297 WARN  (qtp2095668191-427) [n:127.0.0.1:39873_solr    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1509540694201&s=TgZRRgN7/45JZ7meJXCYw5OqVa8="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:34 GMT
   [junit4]   2> 53301 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1509540694190&s=hn2RSQpSANzzy1ShttAE9mzA5yM="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:34 GMT
   [junit4]   2> 53301 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1509540694201&s=TgZRRgN7/45JZ7meJXCYw5OqVa8="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:34 GMT
   [junit4]   2> 53301 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
   [junit4]   2> 53314 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
   [junit4]   2> 64520 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1509540694221&s=H4sOQgjTSOGIHYUzIS9p2qfk0MY="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:34 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:34 GMT
   [junit4]   2> 64520 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
   [junit4]   2> 64521 WARN  (jetty-launcher-64-thread-1-SendThread(127.0.0.1:42655)) [n:127.0.0.1:39873_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13569ms for sessionid 0x15f757d8f2e0008
   [junit4]   2> 64521 WARN  (jetty-launcher-64-thread-2-SendThread(127.0.0.1:42655)) [n:127.0.0.1:39993_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13573ms for sessionid 0x15f757d8f2e0007
   [junit4]   2> 64521 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f757d8f2e0007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 64523 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f757d8f2e0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 64530 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
   [junit4]   2> 64531 INFO  (qtp367482667-421) [    ] o.a.s.s.SolrDispatchFilter Error authenticating
   [junit4]   2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 64532 WARN  (qtp367482667-421) [    ] o.e.j.s.ServletHandler /solr/admin/collections
   [junit4]   2> org.apache.solr.common.SolrException: Error during request authentication, 
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:457)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
   [junit4]   2> 	... 29 more
   [junit4]   2> 64533 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
   [junit4]   2> 64542 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
   [junit4]   2> 64550 WARN  (qtp367482667-425) [n:127.0.0.1:39993_solr    ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: ‘bar’: no such user
   [junit4]   2> id: ‘bar’: no such user
   [junit4]   2> 
   [junit4]   2> 64552 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=test&e=1509540705450&s=e8vcl7igPTGkXenQnBK/vYct558="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:45 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:45 GMT
   [junit4]   2> 64552 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
   [junit4]   2> 64559 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
   [junit4]   2> 64560 INFO  (qtp367482667-418) [n:127.0.0.1:39993_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 64560 INFO  (qtp367482667-418) [n:127.0.0.1:39993_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 64561 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1509540705465&s=yLwrb+k6botOndbPTHxHXKiV8hs="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:45 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:45 GMT
   [junit4]   2> 64561 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
   [junit4]   2> 64573 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
   [junit4]   2> 64580 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[38A6CE7C69683E4A]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1509540705479&s=cbDooyV5Rtdg0b/XT5Ck+GT5KII="; Path=/; Domain=127.0.0.1; Expires=ke, 01-marraskuuta-2017 12:51:45 GMT; Secure; HttpOnly". Invalid 'expires' attribute: ke, 01-marraskuuta-2017 12:51:45 GMT
   [junit4]   2> 64580 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[38A6CE7C69683E4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
   [junit4]   2> 64622 INFO  (jetty-launcher-64-thread-1-EventThread) [n:127.0.0.1:39873_solr    ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
   [junit4]   2> 64627 INFO  (jetty-closer-65-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@7dfe6449{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 64627 INFO  (jetty-closer-65-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1027342551
   [junit4]   2> 64627 INFO  (jetty-closer-65-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 64628 INFO  (jetty-closer-65-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@34b90bec: rootName = solr_39993, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@beb6230
   [junit4]   2> 64634 INFO  (jetty-closer-65-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 64634 INFO  (jetty-closer-65-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6e268: rootName = solr_39993, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@45236861
   [junit4]   2> 64635 INFO  (jetty-closer-65-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@45c4352c{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 64635 INFO  (jetty-closer-65-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1312178004
   [junit4]   2> 64635 INFO  (jetty-closer-65-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 64635 INFO  (jetty-closer-65-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5bf0bd4a: rootName = solr_39873, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@67a39c31
   [junit4]   2> 64639 INFO  (jetty-closer-65-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 64639 INFO  (jetty-closer-65-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@686e6979: rootName = solr_39993, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@154267b2
   [junit4]   2> 64641 INFO  (jetty-closer-65-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:39993_solr
   [junit4]   2> 64642 INFO  (zkCallback-76-thread-1-processing-n:127.0.0.1:39873_solr) [n:127.0.0.1:39873_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 64642 INFO  (zkCallback-75-thread-3-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 64642 INFO  (jetty-closer-65-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 64642 INFO  (zkCallback-75-thread-2-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 64642 INFO  (zkCallback-75-thread-1-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 64644 INFO  (jetty-closer-65-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 64644 INFO  (jetty-closer-65-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4b23ef7e: rootName = solr_39873, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@45236861
   [junit4]   2> 64648 INFO  (jetty-closer-65-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 64648 INFO  (jetty-closer-65-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5257d77c: rootName = solr_39873, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@154267b2
   [junit4]   2> 64649 INFO  (coreCloseExecutor-182-thread-1) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7b4986f7
   [junit4]   2> 64649 INFO  (coreCloseExecutor-182-thread-1) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=2068416247
   [junit4]   2> 64649 INFO  (coreCloseExecutor-182-thread-1) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6c7126cc: rootName = solr_39993, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@790ff65a
   [junit4]   2> 64653 INFO  (jetty-closer-65-thread-2) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:39873_solr
   [junit4]   2> 64657 INFO  (jetty-closer-65-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 64658 INFO  (zkCallback-76-thread-1-processing-n:127.0.0.1:39873_solr) [n:127.0.0.1:39873_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 64658 INFO  (zkCallback-75-thread-2-processing-n:127.0.0.1:39993_solr) [n:127.0.0.1:39993_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 64658 ERROR (Thread[Thread-128,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:39873_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 64661 INFO  (coreCloseExecutor-182-thread-1) [n:127.0.0.1:39993_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=2068416247
   [junit4]   2> 64666 INFO  (jetty-closer-65-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98926898958958597-127.0.0.1:39993_solr-n_0000000000) closing
   [junit4]   2> 64666 INFO  (OverseerStateUpdate-98926898958958597-127.0.0.1:39993_solr-n_0000000000) [n:127.0.0.1:39993_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:39993_solr
   [junit4]   2> 64666 WARN  (OverseerAutoScalingTriggerThread-98926898958958597-127.0.0.1:39993_solr-n_0000000000) [n:127.0.0.1:39993_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 64667 ERROR (Thread[Thread-125,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:39993_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 64817 INFO  (jetty-closer-65-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3e8f754a{/solr,null,UNAVAILABLE}
   [junit4]   2> 64870 INFO  (jetty-closer-65-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4f7bb8e5{/solr,null,UNAVAILABLE}
   [junit4]   2> 64871 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 64871 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42655 42655
   [junit4]   2> 69904 INFO  (Thread-108) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42655 42655
   [junit4]   2> 69905 WARN  (Thread-108) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/collections/forwardingCollection/state.json
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
   [junit4]   2> 
   [junit4]   2> 69920 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Nov 01, 2017 2:51:50 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> Nov 01, 2017 2:52:10 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   [junit4]   2>    1) Thread[id=469, name=jetty-launcher-64-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2>         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2>    2) Thread[id=468, name=jetty-launcher-64-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValu

[...truncated too long message...]

shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@93f2fa7: rootName = solr_37685, domain = solr.core.testSimple3.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.testSimple3.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@11b76913
   [junit4]   2> 1102908 INFO  (coreCloseExecutor-2971-thread-3) [n:127.0.0.1:34623_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple2.shard2.leader, tag=833048516
   [junit4]   2> 1102911 INFO  (coreCloseExecutor-2972-thread-4) [n:127.0.0.1:34105_solr c:testSimple1 s:shard1 r:core_node12 x:testSimple1_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard1.leader, tag=1672332973
   [junit4]   2> 1102911 INFO  (jetty-closer-941-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@41b227f7{/solr,null,UNAVAILABLE}
   [junit4]   2> 1102911 INFO  (coreCloseExecutor-2972-thread-3) [n:127.0.0.1:34105_solr c:testSimple1 s:shard2 r:core_node10 x:testSimple1_shard2_replica_n9] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testSimple1.shard2.replica_n9, tag=329360277
   [junit4]   2> 1102913 INFO  (coreCloseExecutor-2972-thread-3) [n:127.0.0.1:34105_solr c:testSimple1 s:shard2 r:core_node10 x:testSimple1_shard2_replica_n9] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@340e470f: rootName = solr_34105, domain = solr.core.testSimple1.shard2.replica_n9, service url = null, agent id = null] for registry solr.core.testSimple1.shard2.replica_n9 / com.codahale.metrics.MetricRegistry@2261c9ae
   [junit4]   2> 1102918 INFO  (coreCloseExecutor-2970-thread-2) [n:127.0.0.1:37685_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard2.leader, tag=482900500
   [junit4]   2> 1102918 INFO  (coreCloseExecutor-2970-thread-4) [n:127.0.0.1:37685_solr c:testSimple3 s:shard1 r:core_node3 x:testSimple3_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple3.shard1.leader, tag=698179692
   [junit4]   2> 1102918 INFO  (coreCloseExecutor-2972-thread-1) [n:127.0.0.1:34105_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple2.shard1.leader, tag=1056508866
   [junit4]   2> 1102918 INFO  (coreCloseExecutor-2972-thread-2) [n:127.0.0.1:34105_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple2.shard2.leader, tag=717378881
   [junit4]   2> 1102918 INFO  (coreCloseExecutor-2970-thread-5) [n:127.0.0.1:37685_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple3.shard2.leader, tag=1900856603
   [junit4]   2> 1102918 INFO  (coreCloseExecutor-2972-thread-3) [n:127.0.0.1:34105_solr c:testSimple1 s:shard2 r:core_node10 x:testSimple1_shard2_replica_n9] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard2.leader, tag=329360277
   [junit4]   2> 1102940 INFO  (zkCallback-957-thread-6-processing-n:127.0.0.1:34105_solr) [n:127.0.0.1:34105_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1102940 INFO  (jetty-closer-941-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98926959213084680-127.0.0.1:37685_solr-n_0000000001) closing
   [junit4]   2> 1102940 INFO  (zkCallback-957-thread-5-processing-n:127.0.0.1:34105_solr) [n:127.0.0.1:34105_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1102940 INFO  (OverseerStateUpdate-98926959213084680-127.0.0.1:37685_solr-n_0000000001) [n:127.0.0.1:37685_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37685_solr
   [junit4]   2> 1102940 WARN  (OverseerAutoScalingTriggerThread-98926959213084680-127.0.0.1:37685_solr-n_0000000001) [n:127.0.0.1:37685_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1102942 DEBUG (jetty-closer-941-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 1102942 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f758b969b0009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1102942 INFO  (jetty-closer-941-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@32327edd{/solr,null,UNAVAILABLE}
   [junit4]   2> 1102943 INFO  (jetty-closer-941-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2c0ab4b8{/solr,null,UNAVAILABLE}
   [junit4]   2> 1102943 ERROR (SUITE-AutoAddReplicasIntegrationTest-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1102943 INFO  (SUITE-AutoAddReplicasIntegrationTest-seed#[38A6CE7C69683E4A]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40217 40217
   [junit4]   2> 1102972 INFO  (Thread-2099) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40217 40217
   [junit4]   2> 1102974 WARN  (Thread-2099) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	25	/solr/collections/testSimple2/state.json
   [junit4]   2> 	14	/solr/collections/testSimple1/state.json
   [junit4]   2> 	6	/solr/collections/testSimple3/state.json
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/collections/testSimple1/leader_elect/shard2/election/98926959213084680-core_node7-n_0000000000
   [junit4]   2> 	2	/solr/collections/testSimple1/leader_elect/shard1/election/98926959213084680-core_node3-n_0000000000
   [junit4]   2> 	2	/solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/live_nodes
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 	2	/solr/overseer/queue
   [junit4]   2> 	2	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	2	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_38A6CE7C69683E4A-001
   [junit4]   2> Nov 01, 2017 3:09:03 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 4 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1365, maxMBSortInHeap=7.07984316907428, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3b60ab06), locale=cs, timezone=America/Shiprock
   [junit4]   2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=316974368,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [AssignTest, TestBM25SimilarityFactory, UpdateLogTest, HdfsNNFailoverTest, RulesTest, V2ApiIntegrationTest, DebugComponentTest, TestAuthenticationFramework, SecurityConfHandlerTest, TestRangeQuery, TestDeleteCollectionOnDownNodes, TestSizeLimitedDistributedMap, TestSurroundQueryParser, TestSolrQueryParser, TermVectorComponentDistributedTest, HealthCheckHandlerTest, ShardSplitTest, ShardRoutingTest, TestManagedSynonymGraphFilterFactory, ReplaceNodeTest, HdfsDirectoryTest, SolrMetricsIntegrationTest, BlockCacheTest, BlockJoinFacetSimpleTest, QueryResultKeyTest, DocValuesMultiTest, TestLazyCores, OpenCloseCoreStressTest, SuggestComponentTest, SolrJmxReporterCloudTest, TestCorePropertiesReload, AtomicUpdateProcessorFactoryTest, SOLR749Test, TestSolrCloudSnapshots, RollingRestartTest, RequestHandlersTest, ChaosMonkeySafeLeaderTest, TestSchemaManager, TestDocumentBuilder, CdcrRequestHandlerTest, BigEndianAscendingWordDeserializerTest, DocExpirationUpdateProcessorFactoryTest, RegexBoostProcessorTest, SignatureUpdateProcessorFactoryTest, JSONWriterTest, TestSolr4Spatial, TestCoreAdminApis, TestStressRecovery, ShardRoutingCustomTest, TestGraphMLResponseWriter, TestUninvertingReader, MoveReplicaHDFSFailoverTest, PKIAuthenticationIntegrationTest, TestLRUStatsCache, TestFieldTypeResource, AutoAddReplicasIntegrationTest]
   [junit4] Completed [289/747 (3!)] on J1 in 140.92s, 1 test, 1 failure <<< FAILURES!

[...truncated 48774 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20805 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20805/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

8 tests failed.
FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testUpdateStream

Error Message:
Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: destinationCollection

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: destinationCollection
	at __randomizedtesting.SeedInfo.seed([E030C84481650261:28770C3E886DFF31]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testUpdateStream(StreamExpressionTest.java:3958)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testCommitStream

Error Message:
Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: destinationCollection

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: destinationCollection
	at __randomizedtesting.SeedInfo.seed([E030C84481650261:5BA6D00A155A60F8]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testCommitStream(StreamExpressionTest.java:4450)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelDaemonCommitStream

Error Message:
Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: parallelDestinationCollection1

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: parallelDestinationCollection1
	at __randomizedtesting.SeedInfo.seed([E030C84481650261:40C699C14414CCFF]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelDaemonCommitStream(StreamExpressionTest.java:4644)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelUpdateStream

Error Message:
Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: parallelDestinationCollection

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: parallelDestinationCollection
	at __randomizedtesting.SeedInfo.seed([E030C84481650261:83DE8BA6DD51F90A]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelUpdateStream(StreamExpressionTest.java:4052)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test

Error Message:
Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_n2","base_url":"http://127.0.0.1:33583","node_name":"127.0.0.1:33583_","state":"active","type":"NRT","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//clusterstate.json/27)={   "pullReplicas":"0",   "replicationFactor":"1",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node4":{           "state":"down",           "base_url":"http://127.0.0.1:42155",           "core":"c8n_1x3_lf_shard1_replica_n1",           "node_name":"127.0.0.1:42155_",           "type":"NRT"},         "core_node5":{           "core":"c8n_1x3_lf_shard1_replica_n2",           "base_url":"http://127.0.0.1:33583",           "node_name":"127.0.0.1:33583_",           "state":"active",           "type":"NRT",           "leader":"true"},         "core_node6":{           "core":"c8n_1x3_lf_shard1_replica_n3",           "base_url":"http://127.0.0.1:35115",           "node_name":"127.0.0.1:35115_",           "state":"down",           "type":"NRT"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"1",   "autoAddReplicas":"false",   "nrtReplicas":"3",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_n2","base_url":"http://127.0.0.1:33583","node_name":"127.0.0.1:33583_","state":"active","type":"NRT","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//clusterstate.json/27)={
  "pullReplicas":"0",
  "replicationFactor":"1",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node4":{
          "state":"down",
          "base_url":"http://127.0.0.1:42155",
          "core":"c8n_1x3_lf_shard1_replica_n1",
          "node_name":"127.0.0.1:42155_",
          "type":"NRT"},
        "core_node5":{
          "core":"c8n_1x3_lf_shard1_replica_n2",
          "base_url":"http://127.0.0.1:33583",
          "node_name":"127.0.0.1:33583_",
          "state":"active",
          "type":"NRT",
          "leader":"true"},
        "core_node6":{
          "core":"c8n_1x3_lf_shard1_replica_n3",
          "base_url":"http://127.0.0.1:35115",
          "node_name":"127.0.0.1:35115_",
          "state":"down",
          "type":"NRT"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false",
  "nrtReplicas":"3",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([28175642070C2EAA:A0436998A9F04352]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:169)
	at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:56)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelTerminatingDaemonUpdateStream

Error Message:
Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: parallelDestinationCollection1

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: parallelDestinationCollection1
	at __randomizedtesting.SeedInfo.seed([E030C84481650261:1154102CD50FCD7F]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelTerminatingDaemonUpdateStream(StreamExpressionTest.java:4327)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testBasicTextLogitStream

Error Message:
Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: destinationCollection

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: destinationCollection
	at __randomizedtesting.SeedInfo.seed([E030C84481650261:57A7CE3B1814F249]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testBasicTextLogitStream(StreamExpressionTest.java:7927)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testClassifyStream

Error Message:
Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: modelCollection

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38195/solr: Could not fully create collection: modelCollection
	at __randomizedtesting.SeedInfo.seed([E030C84481650261:4578527CB83D1BF5]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testClassifyStream(StreamExpressionTest.java:4863)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13356 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/init-core-data-001
   [junit4]   2> 1767271 INFO  (SUITE-LeaderFailoverAfterPartitionTest-seed#[28175642070C2EAA]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1767272 INFO  (SUITE-LeaderFailoverAfterPartitionTest-seed#[28175642070C2EAA]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 1767272 INFO  (SUITE-LeaderFailoverAfterPartitionTest-seed#[28175642070C2EAA]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1767273 INFO  (SUITE-LeaderFailoverAfterPartitionTest-seed#[28175642070C2EAA]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1767274 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1767274 INFO  (Thread-3150) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1767274 INFO  (Thread-3150) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1767275 ERROR (Thread-3150) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1767374 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.ZkTestServer start zk server on port:39679
   [junit4]   2> 1767378 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1767379 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1767379 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1767380 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1767380 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1767380 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1767381 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1767381 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1767381 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1767381 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1767382 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1767382 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 1767430 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1767431 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@19400861{/,null,AVAILABLE}
   [junit4]   2> 1767431 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1c78782a{HTTP/1.1,[http/1.1]}{127.0.0.1:34189}
   [junit4]   2> 1767431 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.Server Started @1768904ms
   [junit4]   2> 1767431 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/tempDir-001/control/data, replicaType=NRT, hostContext=/, hostPort=35115, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/control-001/cores}
   [junit4]   2> 1767432 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1767432 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 1767432 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1767432 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1767432 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-02T18:21:06.850Z
   [junit4]   2> 1767433 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1767433 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/control-001/solr.xml
   [junit4]   2> 1767435 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1767435 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1767436 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2f229c3e, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1767437 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39679/solr
   [junit4]   2> 1767459 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:35115_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1767459 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:35115_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35115_
   [junit4]   2> 1767459 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:35115_    ] o.a.s.c.Overseer Overseer (id=98936217055592452-127.0.0.1:35115_-n_0000000000) starting
   [junit4]   2> 1767461 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:35115_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35115_
   [junit4]   2> 1767461 INFO  (zkCallback-2585-thread-1-processing-n:127.0.0.1:35115_) [n:127.0.0.1:35115_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1767498 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:35115_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f229c3e
   [junit4]   2> 1767504 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:35115_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f229c3e
   [junit4]   2> 1767504 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:35115_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f229c3e
   [junit4]   2> 1767505 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:35115_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/control-001/cores
   [junit4]   2> 1767515 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1767516 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39679/solr ready
   [junit4]   2> 1767516 INFO  (SocketProxy-Acceptor-35115) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=44586,localport=35115], receiveBufferSize:531000
   [junit4]   2> 1767516 INFO  (SocketProxy-Acceptor-35115) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34189,localport=47790], receiveBufferSize=530904
   [junit4]   2> 1767516 INFO  (qtp1533262875-13392) [n:127.0.0.1:35115_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35115_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1767517 INFO  (OverseerThreadFactory-5969-thread-1-processing-n:127.0.0.1:35115_) [n:127.0.0.1:35115_    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 1767619 INFO  (SocketProxy-Acceptor-35115) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=44590,localport=35115], receiveBufferSize:531000
   [junit4]   2> 1767620 INFO  (SocketProxy-Acceptor-35115) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34189,localport=47794], receiveBufferSize=530904
   [junit4]   2> 1767620 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1767620 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1767722 INFO  (zkCallback-2585-thread-1-processing-n:127.0.0.1:35115_) [n:127.0.0.1:35115_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1768647 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1768674 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 1768735 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1768740 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 1768741 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f229c3e
   [junit4]   2> 1768741 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1768741 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 1768742 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=68.8154296875, floorSegmentMB=0.912109375, forceMergeDeletesPctAllowed=18.270044387475973, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2298677546573961
   [junit4]   2> 1768744 WARN  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1768764 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1768764 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1768764 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1768764 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1768765 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1768765 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@61e81cac[control_collection_shard1_replica_n1] main]
   [junit4]   2> 1768766 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1768766 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1768766 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1768767 INFO  (searcherExecutor-5972-thread-1-processing-n:127.0.0.1:35115_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@61e81cac[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1768767 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582979474453954560
   [junit4]   2> 1768769 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1768769 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1768770 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35115/control_collection_shard1_replica_n1/
   [junit4]   2> 1768770 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1768770 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35115/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 1768770 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1768771 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35115/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 1768872 INFO  (zkCallback-2585-thread-2-processing-n:127.0.0.1:35115_) [n:127.0.0.1:35115_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1768921 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1768923 INFO  (qtp1533262875-13394) [n:127.0.0.1:35115_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1303
   [junit4]   2> 1768926 INFO  (qtp1533262875-13392) [n:127.0.0.1:35115_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1769024 INFO  (zkCallback-2585-thread-2-processing-n:127.0.0.1:35115_) [n:127.0.0.1:35115_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1769519 INFO  (OverseerCollectionConfigSetProcessor-98936217055592452-127.0.0.1:35115_-n_0000000000) [n:127.0.0.1:35115_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1769926 INFO  (qtp1533262875-13392) [n:127.0.0.1:35115_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35115_&wt=javabin&version=2} status=0 QTime=2409
   [junit4]   2> 1769932 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1769932 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39679/solr ready
   [junit4]   2> 1769932 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1769933 INFO  (SocketProxy-Acceptor-35115) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=44600,localport=35115], receiveBufferSize:531000
   [junit4]   2> 1769934 INFO  (SocketProxy-Acceptor-35115) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34189,localport=47804], receiveBufferSize=530904
   [junit4]   2> 1769935 INFO  (qtp1533262875-13392) [n:127.0.0.1:35115_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1769936 INFO  (OverseerThreadFactory-5969-thread-2-processing-n:127.0.0.1:35115_) [n:127.0.0.1:35115_    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 1769937 WARN  (OverseerThreadFactory-5969-thread-2-processing-n:127.0.0.1:35115_) [n:127.0.0.1:35115_    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 1770141 INFO  (qtp1533262875-13392) [n:127.0.0.1:35115_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1770141 INFO  (qtp1533262875-13392) [n:127.0.0.1:35115_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=206
   [junit4]   2> 1770211 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/shard-1-001 of type NRT
   [junit4]   2> 1770211 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1770212 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@54fd06a6{/,null,AVAILABLE}
   [junit4]   2> 1770212 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5c3c46dd{HTTP/1.1,[http/1.1]}{127.0.0.1:38077}
   [junit4]   2> 1770212 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.Server Started @1771684ms
   [junit4]   2> 1770212 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=33395, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/shard-1-001/cores}
   [junit4]   2> 1770212 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1770212 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 1770212 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1770212 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1770213 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-02T18:21:09.630Z
   [junit4]   2> 1770214 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f7df719050007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1770214 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1770214 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/shard-1-001/solr.xml
   [junit4]   2> 1770216 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1770216 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1770217 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2f229c3e, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1770218 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39679/solr
   [junit4]   2> 1770222 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:33395_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1770222 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:33395_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1770223 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:33395_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33395_
   [junit4]   2> 1770223 INFO  (zkCallback-2585-thread-2-processing-n:127.0.0.1:35115_) [n:127.0.0.1:35115_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1770223 INFO  (zkCallback-2598-thread-1-processing-n:127.0.0.1:33395_) [n:127.0.0.1:33395_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1770223 INFO  (zkCallback-2593-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1770280 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:33395_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f229c3e
   [junit4]   2> 1770286 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:33395_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f229c3e
   [junit4]   2> 1770286 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:33395_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f229c3e
   [junit4]   2> 1770287 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [n:127.0.0.1:33395_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/shard-1-001/cores
   [junit4]   2> 1770300 INFO  (SocketProxy-Acceptor-33395) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=50156,localport=33395], receiveBufferSize:531000
   [junit4]   2> 1770300 INFO  (SocketProxy-Acceptor-33395) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38077,localport=54586], receiveBufferSize=530904
   [junit4]   2> 1770300 INFO  (qtp337057232-13446) [n:127.0.0.1:33395_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:33395_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1770301 INFO  (OverseerCollectionConfigSetProcessor-98936217055592452-127.0.0.1:35115_-n_0000000000) [n:127.0.0.1:35115_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1770302 INFO  (OverseerThreadFactory-5969-thread-3-processing-n:127.0.0.1:35115_) [n:127.0.0.1:35115_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:33395_ for creating new replica
   [junit4]   2> 1770302 INFO  (SocketProxy-Acceptor-33395) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=50160,localport=33395], receiveBufferSize:531000
   [junit4]   2> 1770302 INFO  (SocketProxy-Acceptor-33395) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38077,localport=54590], receiveBufferSize=530904
   [junit4]   2> 1770302 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1770303 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1771326 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1771340 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
   [junit4]   2> 1771405 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1771411 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
   [junit4]   2> 1771411 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f229c3e
   [junit4]   2> 1771411 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1771411 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
   [junit4]   2> 1771412 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=68.8154296875, floorSegmentMB=0.912109375, forceMergeDeletesPctAllowed=18.270044387475973, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2298677546573961
   [junit4]   2> 1771414 WARN  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1771441 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1771441 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1771442 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1771442 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1771443 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1771443 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b746a93[collection1_shard2_replica_n41] main]
   [junit4]   2> 1771444 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1771444 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1771444 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1771445 INFO  (searcherExecutor-5983-thread-1-processing-n:127.0.0.1:33395_ x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@3b746a93[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1771445 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582979477262041088
   [junit4]   2> 1771447 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1771447 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1771447 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33395/collection1_shard2_replica_n41/
   [junit4]   2> 1771447 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1771447 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:33395/collection1_shard2_replica_n41/ has no replicas
   [junit4]   2> 1771447 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1771448 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33395/collection1_shard2_replica_n41/ shard2
   [junit4]   2> 1771599 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1771600 INFO  (qtp337057232-13448) [n:127.0.0.1:33395_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1297
   [junit4]   2> 1771602 INFO  (qtp337057232-13446) [n:127.0.0.1:33395_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:33395_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1301
   [junit4]   2> 1771674 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/shard-2-001 of type NRT
   [junit4]   2> 1771675 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1771676 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3ab1c0bb{/,null,AVAILABLE}
   [junit4]   2> 1771676 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@360704a3{HTTP/1.1,[http/1.1]}{127.0.0.1:43609}
   [junit4]   2> 1771676 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.e.j.s.Server Started @1773148ms
   [junit4]   2> 1771676 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=33583, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/shard-2-001/cores}
   [junit4]   2> 1771676 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1771676 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 1771676 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1771676 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1771676 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-02T18:21:11.094Z
   [junit4]   2> 1771678 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1771678 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_28175642070C2EAA-001/shard-2-001/solr.xml
   [junit4]   2> 1771680 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1771680 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1771681 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[28175642070C2EAA]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2f229c3e, but no JMX reporters were configured - adding def

[...truncated too long message...]

read-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7cd3522e{/solr,null,UNAVAILABLE}
   [junit4]   2> 367231 WARN  (OverseerAutoScalingTriggerThread-98936284668493833-127.0.0.1:40897_solr-n_0000000000) [n:127.0.0.1:40897_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 367233 INFO  (jetty-closer-220-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6d537211{/solr,null,UNAVAILABLE}
   [junit4]   2> 367233 INFO  (zkCallback-241-thread-4-processing-n:127.0.0.1:35467_solr) [n:127.0.0.1:35467_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35467_solr
   [junit4]   2> 367234 INFO  (coreCloseExecutor-693-thread-1) [n:127.0.0.1:35467_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=586376377
   [junit4]   2> 367238 INFO  (jetty-closer-220-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4999fadd{/solr,null,UNAVAILABLE}
   [junit4]   2> 368720 WARN  (zkCallback-240-thread-3-processing-n:127.0.0.1:38195_solr) [n:127.0.0.1:38195_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 368720 WARN  (zkCallback-240-thread-2-processing-n:127.0.0.1:38195_solr) [n:127.0.0.1:38195_solr    ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:38195_solr
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:38195_solr
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:357)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:357)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:879)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:749)
   [junit4]   2> 	at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:748)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1154)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1149)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$0(SolrZkClient.java:262)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 368721 INFO  (jetty-closer-220-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@15b36bc2{/solr,null,UNAVAILABLE}
   [junit4]   2> 368721 ERROR (SUITE-StreamExpressionTest-seed#[E030C84481650261]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 368721 INFO  (SUITE-StreamExpressionTest-seed#[E030C84481650261]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36135 36135
   [junit4]   2> 373748 INFO  (Thread-240) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36135 36135
   [junit4]   2> 373749 WARN  (Thread-240) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	77	/solr/aliases.json
   [junit4]   2> 	77	/solr/clusterprops.json
   [junit4]   2> 	8	/solr/configs/conf
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	2	/solr/configs/ml
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	77	/solr/clusterstate.json
   [junit4]   2> 	10	/solr/collections/mainCorpus1/state.json
   [junit4]   2> 	10	/solr/collections/destination/state.json
   [junit4]   2> 	10	/solr/collections/destination1/state.json
   [junit4]   2> 	10	/solr/collections/collection1/state.json
   [junit4]   2> 	10	/solr/collections/parallelDestinationCollection/state.json
   [junit4]   2> 	10	/solr/collections/workQueue1/state.json
   [junit4]   2> 	10	/solr/collections/workQueue/state.json
   [junit4]   2> 	10	/solr/collections/parallelDestinationCollection1/state.json
   [junit4]   2> 	10	/solr/collections/destinationCollection/state.json
   [junit4]   2> 	10	/solr/collections/mainCorpus/state.json
   [junit4]   2> 	2	/solr/overseer_elect/election/98936284668493833-127.0.0.1:40897_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	77	/solr/live_nodes
   [junit4]   2> 	77	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.io.stream.StreamExpressionTest_E030C84481650261-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {expr_s=PostingsFormat(name=Memory), join2_s=PostingsFormat(name=Direct), multiDefault=PostingsFormat(name=Direct), subject=PostingsFormat(name=Direct), price_f=PostingsFormat(name=Direct), a1_s=FSTOrd50, intDefault=FSTOrd50, a_f=FSTOrd50, a2_s=PostingsFormat(name=Memory), join1_i=PostingsFormat(name=Memory), a_i=PostingsFormat(name=MockRandom), test_i=PostingsFormat(name=Direct), join3_i=PostingsFormat(name=MockRandom), field_i=PostingsFormat(name=Direct), level1_s=PostingsFormat(name=Memory), body_t=PostingsFormat(name=MockRandom), s_multi=PostingsFormat(name=Memory), col_s=FSTOrd50, level2_s=FSTOrd50, a_ss=PostingsFormat(name=Direct), a_s=PostingsFormat(name=Memory), score_f=PostingsFormat(name=Memory), term_s=PostingsFormat(name=Direct), a_t=PostingsFormat(name=Direct), id=PostingsFormat(name=MockRandom), text=PostingsFormat(name=Memory), timestamp=PostingsFormat(name=Direct), i_multi=PostingsFormat(name=MockRandom), featureSet_s=FSTOrd50, idf_d=FSTOrd50, index_i=FSTOrd50, b_ls=FSTOrd50, test_dt=PostingsFormat(name=Memory), out_i=FSTOrd50, checkpoint_ss=PostingsFormat(name=MockRandom), test_t=PostingsFormat(name=MockRandom), ident_s=FSTOrd50, order_i=PostingsFormat(name=Direct), whitetok=PostingsFormat(name=MockRandom), _version_=FSTOrd50, side_s=PostingsFormat(name=MockRandom), miles_i=FSTOrd50}, docValues:{expr_s=DocValuesFormat(name=Asserting), join2_s=DocValuesFormat(name=Direct), multiDefault=DocValuesFormat(name=Direct), price_f=DocValuesFormat(name=Direct), a1_s=DocValuesFormat(name=Lucene70), intDefault=DocValuesFormat(name=Lucene70), a_f=DocValuesFormat(name=Lucene70), a2_s=DocValuesFormat(name=Asserting), join1_i=DocValuesFormat(name=Asserting), a_i=DocValuesFormat(name=Memory), test_i=DocValuesFormat(name=Direct), join3_i=DocValuesFormat(name=Memory), field_i=DocValuesFormat(name=Direct), level1_s=DocValuesFormat(name=Asserting), s_multi=DocValuesFormat(name=Asserting), col_s=DocValuesFormat(name=Lucene70), level2_s=DocValuesFormat(name=Lucene70), a_ss=DocValuesFormat(name=Direct), a_s=DocValuesFormat(name=Asserting), score_f=DocValuesFormat(name=Asserting), term_s=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Direct), i_multi=DocValuesFormat(name=Memory), featureSet_s=DocValuesFormat(name=Lucene70), idf_d=DocValuesFormat(name=Lucene70), index_i=DocValuesFormat(name=Lucene70), b_ls=DocValuesFormat(name=Lucene70), test_dt=DocValuesFormat(name=Asserting), out_i=DocValuesFormat(name=Lucene70), checkpoint_ss=DocValuesFormat(name=Memory), ident_s=DocValuesFormat(name=Lucene70), order_i=DocValuesFormat(name=Direct), _version_=DocValuesFormat(name=Lucene70), side_s=DocValuesFormat(name=Memory), miles_i=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=1344, maxMBSortInHeap=6.374700127522814, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@d2f9370), locale=es-CO, timezone=Etc/GMT+1
   [junit4]   2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=295739080,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [SolrParamTest, TestCloudSolrClientConnections, ModifiableSolrParamsTest, TestCollectionStateWatchers, SolrExampleXMLTest, AddEvaluatorTest, NoOpResponseParserTest, GreaterThanEqualToEvaluatorTest, CosineEvaluatorTest, TestSolrJErrorHandling, ArrayEvaluatorTest, ArcCosineEvaluatorTest, TestJsonRecordReader, HyperbolicSineEvaluatorTest, SolrExceptionTest, SineEvaluatorTest, TestBatchUpdate, OperationsTest, HttpSolrClientBuilderTest, NamedListTest, TestCoreAdmin, LBHttpSolrClientBuilderTest, TestValidatingJsonMap, TangentEvaluatorTest, GraphTest, JDBCStreamTest, StreamExpressionTest]
   [junit4] Completed [146/146 (1!)] on J2 in 282.95s, 128 tests, 7 errors <<< FAILURES!

[...truncated 46286 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20804 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20804/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.servlet.HttpSolrCallGetCoreTest

Error Message:
Error from server at https://127.0.0.1:36255/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:36255/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([AA28E36B9A89E8A0]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.servlet.HttpSolrCallGetCoreTest.setupCluster(HttpSolrCallGetCoreTest.java:51)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication

Error Message:
Index: 0, Size: 0

Stack Trace:
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
	at __randomizedtesting.SeedInfo.seed([AA28E36B9A89E8A0:BE60B83EB98E55BE]:0)
	at java.util.ArrayList.rangeCheck(ArrayList.java:653)
	at java.util.ArrayList.get(ArrayList.java:429)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication(TestReplicationHandler.java:561)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12595 lines...]
   [junit4] Suite: org.apache.solr.servlet.HttpSolrCallGetCoreTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/init-core-data-001
   [junit4]   2> 876098 WARN  (SUITE-HttpSolrCallGetCoreTest-seed#[AA28E36B9A89E8A0]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> 876099 INFO  (SUITE-HttpSolrCallGetCoreTest-seed#[AA28E36B9A89E8A0]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 876100 INFO  (SUITE-HttpSolrCallGetCoreTest-seed#[AA28E36B9A89E8A0]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 876101 INFO  (SUITE-HttpSolrCallGetCoreTest-seed#[AA28E36B9A89E8A0]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 876101 INFO  (SUITE-HttpSolrCallGetCoreTest-seed#[AA28E36B9A89E8A0]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001
   [junit4]   2> 876101 INFO  (SUITE-HttpSolrCallGetCoreTest-seed#[AA28E36B9A89E8A0]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 876102 INFO  (Thread-2607) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 876102 INFO  (Thread-2607) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 876118 ERROR (Thread-2607) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 876202 INFO  (SUITE-HttpSolrCallGetCoreTest-seed#[AA28E36B9A89E8A0]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:41569
   [junit4]   2> 876209 INFO  (jetty-launcher-1021-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 876221 INFO  (jetty-launcher-1021-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5f824e78{/solr,null,AVAILABLE}
   [junit4]   2> 876222 INFO  (jetty-launcher-1021-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1cac1a5{SSL,[ssl, http/1.1]}{127.0.0.1:36255}
   [junit4]   2> 876222 INFO  (jetty-launcher-1021-thread-1) [    ] o.e.j.s.Server Started @877632ms
   [junit4]   2> 876222 INFO  (jetty-launcher-1021-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36255}
   [junit4]   2> 876223 ERROR (jetty-launcher-1021-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 876223 INFO  (jetty-launcher-1021-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 876223 INFO  (jetty-launcher-1021-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 876223 INFO  (jetty-launcher-1021-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 876223 INFO  (jetty-launcher-1021-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-02T15:05:41.096Z
   [junit4]   2> 876224 INFO  (jetty-launcher-1021-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 876245 INFO  (jetty-launcher-1021-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41569/solr
   [junit4]   2> 876323 INFO  (jetty-launcher-1021-thread-1) [n:127.0.0.1:36255_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 876324 INFO  (jetty-launcher-1021-thread-1) [n:127.0.0.1:36255_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36255_solr
   [junit4]   2> 876324 INFO  (jetty-launcher-1021-thread-1) [n:127.0.0.1:36255_solr    ] o.a.s.c.Overseer Overseer (id=98935448599003139-127.0.0.1:36255_solr-n_0000000000) starting
   [junit4]   2> 876343 INFO  (jetty-launcher-1021-thread-1) [n:127.0.0.1:36255_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36255_solr
   [junit4]   2> 876348 INFO  (zkCallback-1028-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 876462 INFO  (jetty-launcher-1021-thread-1) [n:127.0.0.1:36255_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36255.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c80f951
   [junit4]   2> 876469 INFO  (jetty-launcher-1021-thread-1) [n:127.0.0.1:36255_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36255.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c80f951
   [junit4]   2> 876469 INFO  (jetty-launcher-1021-thread-1) [n:127.0.0.1:36255_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36255.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c80f951
   [junit4]   2> 876470 INFO  (jetty-launcher-1021-thread-1) [n:127.0.0.1:36255_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/.
   [junit4]   2> 876516 INFO  (SUITE-HttpSolrCallGetCoreTest-seed#[AA28E36B9A89E8A0]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 876517 INFO  (SUITE-HttpSolrCallGetCoreTest-seed#[AA28E36B9A89E8A0]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41569/solr ready
   [junit4]   2> 876555 INFO  (qtp103408872-7652) [n:127.0.0.1:36255_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=config&maxShardsPerNode=6&name=collection1&nrtReplicas=2&action=CREATE&numShards=3&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 876581 INFO  (OverseerThreadFactory-2582-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 876581 WARN  (OverseerThreadFactory-2582-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.CreateCollectionCmd Specified number of replicas of 2 on collection collection1 is higher than the number of Solr instances currently live or live and part of your createNodeSet(1). It's unusual to run two replica of the same slice on the same Solr-instance.
   [junit4]   2> 876690 INFO  (OverseerStateUpdate-98935448599003139-127.0.0.1:36255_solr-n_0000000000) [n:127.0.0.1:36255_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"collection1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36255/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 876692 INFO  (OverseerStateUpdate-98935448599003139-127.0.0.1:36255_solr-n_0000000000) [n:127.0.0.1:36255_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"collection1_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36255/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 876693 INFO  (OverseerStateUpdate-98935448599003139-127.0.0.1:36255_solr-n_0000000000) [n:127.0.0.1:36255_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"collection1_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36255/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 876694 INFO  (OverseerStateUpdate-98935448599003139-127.0.0.1:36255_solr-n_0000000000) [n:127.0.0.1:36255_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"collection1_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36255/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 876695 INFO  (OverseerStateUpdate-98935448599003139-127.0.0.1:36255_solr-n_0000000000) [n:127.0.0.1:36255_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"collection1_shard3_replica_n8",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36255/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 876697 INFO  (OverseerStateUpdate-98935448599003139-127.0.0.1:36255_solr-n_0000000000) [n:127.0.0.1:36255_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"collection1_shard3_replica_n10",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36255/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 876922 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=config&newCollection=true&name=collection1_shard1_replica_n3&action=CREATE&numShards=3&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 876922 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=config&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=3&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 876922 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 876923 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=config&newCollection=true&name=collection1_shard2_replica_n4&action=CREATE&numShards=3&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 876923 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node12&collection.configName=config&newCollection=true&name=collection1_shard3_replica_n10&action=CREATE&numShards=3&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 876923 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=config&newCollection=true&name=collection1_shard3_replica_n8&action=CREATE&numShards=3&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 876923 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=config&newCollection=true&name=collection1_shard2_replica_n6&action=CREATE&numShards=3&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 877049 INFO  (zkCallback-1028-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 877931 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 877931 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 877931 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 877951 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.s.IndexSchema [collection1_shard3_replica_n8] Schema name=minimal
   [junit4]   2> 877953 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.s.IndexSchema [collection1_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 877954 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 877955 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 877955 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n6' using configuration from collection collection1, trusted=true
   [junit4]   2> 877959 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.s.IndexSchema [collection1_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 877961 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36255.solr.core.collection1.shard2.replica_n6' (registry 'solr.core.collection1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c80f951
   [junit4]   2> 877961 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 877961 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.SolrCore [[collection1_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/collection1_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/./collection1_shard2_replica_n6/data/]
   [junit4]   2> 877963 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 877964 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.s.IndexSchema [collection1_shard1_replica_n3] Schema name=minimal
   [junit4]   2> 877966 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 877966 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n3' using configuration from collection collection1, trusted=true
   [junit4]   2> 877969 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36255.solr.core.collection1.shard1.replica_n3' (registry 'solr.core.collection1.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c80f951
   [junit4]   2> 877969 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 877969 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.SolrCore [[collection1_shard1_replica_n3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/collection1_shard1_replica_n3], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/./collection1_shard1_replica_n3/data/]
   [junit4]   2> 877970 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 877993 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 877994 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard3_replica_n8' using configuration from collection collection1, trusted=true
   [junit4]   2> 877995 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36255.solr.core.collection1.shard3.replica_n8' (registry 'solr.core.collection1.shard3.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c80f951
   [junit4]   2> 877995 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 877995 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.SolrCore [[collection1_shard3_replica_n8] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/collection1_shard3_replica_n8], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/./collection1_shard3_replica_n8/data/]
   [junit4]   2> 877996 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 877996 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n4' using configuration from collection collection1, trusted=true
   [junit4]   2> 877996 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36255.solr.core.collection1.shard2.replica_n4' (registry 'solr.core.collection1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c80f951
   [junit4]   2> 877996 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 877996 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.c.SolrCore [[collection1_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/collection1_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/./collection1_shard2_replica_n4/data/]
   [junit4]   2> 878001 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema [collection1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 878004 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.s.IndexSchema [collection1_shard3_replica_n10] Schema name=minimal
   [junit4]   2> 878005 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 878005 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard3_replica_n10' using configuration from collection collection1, trusted=true
   [junit4]   2> 878006 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36255.solr.core.collection1.shard3.replica_n10' (registry 'solr.core.collection1.shard3.replica_n10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c80f951
   [junit4]   2> 878006 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 878006 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.c.SolrCore [[collection1_shard3_replica_n10] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/collection1_shard3_replica_n10], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/./collection1_shard3_replica_n10/data/]
   [junit4]   2> 878024 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 878024 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from collection collection1, trusted=true
   [junit4]   2> 878025 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36255.solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c80f951
   [junit4]   2> 878025 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 878025 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/collection1_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.servlet.HttpSolrCallGetCoreTest_AA28E36B9A89E8A0-001/tempDir-001/node1/./collection1_shard1_replica_n1/data/]
   [junit4]   2> 878049 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 878049 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 878049 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 878049 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 878050 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 878050 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 878050 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 878050 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 878052 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@22bea769[collection1_shard2_replica_n6] main]
   [junit4]   2> 878053 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 878053 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 878053 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@5c49e441[collection1_shard1_replica_n3] main]
   [junit4]   2> 878054 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 878054 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 878056 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 878056 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.s.SolrIndexSearcher Opening [Searcher@33e6979[collection1_shard3_replica_n8] main]
   [junit4]   2> 878056 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 878057 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 878057 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 878058 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 878058 INFO  (searcherExecutor-2585-thread-1-processing-n:127.0.0.1:36255_solr x:collection1_shard2_replica_n6 s:shard2 c:collection1 r:core_node9) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.SolrCore [collection1_shard2_replica_n6] Registered new searcher Searcher@22bea769[collection1_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 878058 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582967179634016256
   [junit4]   2> 878058 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 878058 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582967179634016256
   [junit4]   2> 878060 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 878088 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 878090 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 878090 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582967179667570688
   [junit4]   2> 878093 INFO  (searcherExecutor-2586-thread-1-processing-n:127.0.0.1:36255_solr x:collection1_shard1_replica_n3 s:shard1 c:collection1 r:core_node5) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.SolrCore [collection1_shard1_replica_n3] Registered new searcher Searcher@5c49e441[collection1_shard1_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 878100 INFO  (searcherExecutor-2587-thread-1-processing-n:127.0.0.1:36255_solr x:collection1_shard3_replica_n8 s:shard3 c:collection1 r:core_node11) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.SolrCore [collection1_shard3_replica_n8] Registered new searcher Searcher@33e6979[collection1_shard3_replica_n8] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 878105 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard3: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 878111 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 878114 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 878119 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 878120 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 878120 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 878120 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 878121 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 878122 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 878123 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 878123 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 878124 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.s.SolrIndexSearcher Opening [Searcher@12aba246[collection1_shard3_replica_n10] main]
   [junit4]   2> 878124 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b4292c1[collection1_shard2_replica_n4] main]
   [junit4]   2> 878153 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 878153 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 878153 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 878153 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 878154 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 878154 INFO  (qtp103408872-7655) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582967179734679552
   [junit4]   2> 878154 INFO  (searcherExecutor-2589-thread-1-processing-n:127.0.0.1:36255_solr x:collection1_shard3_replica_n10 s:shard3 c:collection1 r:core_node12) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.c.SolrCore [collection1_shard3_replica_n10] Registered new searcher Searcher@12aba246[collection1_shard3_replica_n10] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 878155 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 878155 INFO  (searcherExecutor-2588-thread-1-processing-n:127.0.0.1:36255_solr x:collection1_shard2_replica_n4 s:shard2 c:collection1 r:core_node7) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.c.SolrCore [collection1_shard2_replica_n4] Registered new searcher Searcher@3b4292c1[collection1_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 878155 INFO  (qtp103408872-7659) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582967179735728128
   [junit4]   2> 878156 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 878156 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 878157 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 878157 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 878158 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@719df7e0[collection1_shard1_replica_n1] main]
   [junit4]   2> 878159 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 878159 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 878159 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 878160 INFO  (searcherExecutor-2592-thread-1-processing-n:127.0.0.1:36255_solr x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@719df7e0[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 878160 INFO  (qtp103408872-7653) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582967179740971008
   [junit4]   2> 878605 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 878605 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 878605 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:36255/solr/collection1_shard3_replica_n8/
   [junit4]   2> 878605 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.u.PeerSync PeerSync: core=collection1_shard3_replica_n8 url=https://127.0.0.1:36255/solr START replicas=[https://127.0.0.1:36255/solr/collection1_shard3_replica_n10/] nUpdates=100
   [junit4]   2> 878609 INFO  (qtp103408872-7695) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node12 x:collection1_shard3_replica_n10] o.a.s.c.S.Request [collection1_shard3_replica_n10]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 878611 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 878611 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 878611 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:36255/solr/collection1_shard2_replica_n6/
   [junit4]   2> 878612 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=collection1_shard2_replica_n6 url=https://127.0.0.1:36255/solr START replicas=[https://127.0.0.1:36255/solr/collection1_shard2_replica_n4/] nUpdates=100
   [junit4]   2> 878612 INFO  (qtp103408872-7718) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4] o.a.s.c.S.Request [collection1_shard2_replica_n4]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 878614 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 878614 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 878614 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:36255/solr/collection1_shard1_replica_n3/
   [junit4]   2> 878614 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n3 url=https://127.0.0.1:36255/solr START replicas=[https://127.0.0.1:36255/solr/collection1_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 878614 INFO  (qtp103408872-7701) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 878906 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.u.PeerSync PeerSync: core=collection1_shard3_replica_n8 url=https://127.0.0.1:36255/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 878906 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 878906 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 878906 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 878908 INFO  (qtp103408872-7654) [n:127.0.0.1:36255_solr c:collection1 s:shard3 r:core_node11 x:collection1_shard3_replica_n8] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:36255/solr/collection1_shard3_replica_n8/ shard3
   [junit4]   2> 878912 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=collection1_shard2_replica_n6 url=https://127.0.0.1:36255/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 878912 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 878912 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 878912 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 878913 INFO  (qtp103408872-7696) [n:127.0.0.1:36255_solr c:collection1 s:shard2 r:core_node9 x:collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:36255/solr/collection1_shard2_replica_n6/ shard2
   [junit4]   2> 878914 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n3 url=https://127.0.0.1:36255/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 878914 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 878914 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 878914 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 878915 INFO  (qtp103408872-7658) [n:127.0.0.1:36255_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:36255/solr/collection1_shard1_replica_n3/ shard1
   [junit4]   2> 1056562 ERROR (qtp103408872-7652) [n:127.0.0.1:36255_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: create the collection time out:180s
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1056563 INFO  (qtp103408872-7652) [n:127.0.0.1:36255_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=config&maxShardsPerNode=6&name=collection1&nrtReplicas=2&action=CREATE&numShards=3&wt=javabin&version=2} status=500 QTime=180007
   [junit4]   2> 1056563 ERROR (qtp103408872-7652) [n:127.0.0.1:36255_solr    ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: create the collection time out:180s
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1056565 ERROR (OverseerThreadFactory-2582-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:36255/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:36255/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:36255 failed to respond
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 1056567 ERROR (OverseerThreadFactory-2582-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:36255/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:36255/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:36255 failed to respond
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 1056568 ERROR (OverseerThreadFactory-2582-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:36255/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:36255/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:36255 failed to respond
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 1056569 ERROR (OverseerThreadFactory-2582-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:36255/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:36255/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:36255 failed to respond
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 1056570 INFO  (jetty-closer-1022-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1cac1a5{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1056570 ERROR (OverseerThreadFactory-2582-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:36255/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:36255/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:36255 failed to respond
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 1056570 INFO  (jetty-closer-1022-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2140976041
   [junit4]   2> 1056571 ERROR (OverseerThreadFactory-2582-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:36255/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:36255/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:36255 failed to respond
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 1056571 INFO  (jetty-closer-1022-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1056571 ERROR (OverseerThreadFactory-2582-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [collection1].
   [junit4]   2> 1056571 INFO  (jetty-closer-1022-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6960c5f9: rootName = solr_36255, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@340868cb
   [junit4]   2> 1056572 INFO  (OverseerThreadFactory-2582-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 1056573 ERROR (OverseerThreadFactory-2582-thread-1-processing-n:127.0.0.1:36255_solr) [n:127.0.0.1:36255_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:36255/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:36255/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:650)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:36255 [/127.0.0.1] failed: Connection refused (Connection refused)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClie

[...truncated too long message...]

=0
   [junit4]   2> 1261955 INFO  (qtp1115713078-14313) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=assertVersions&qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1261955 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testEmptyCommits
   [junit4]   2> 1261955 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@27515f4{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1261955 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=229889468
   [junit4]   2> 1261955 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1261955 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2e80514: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@74d22b32
   [junit4]   2> 1261958 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1261958 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4b133a4a: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7ea7087c
   [junit4]   2> 1261960 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1261960 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@219d1faa: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@22f4708c
   [junit4]   2> 1261961 INFO  (coreCloseExecutor-6122-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@cb24187
   [junit4]   2> 1261961 INFO  (coreCloseExecutor-6122-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=213008775
   [junit4]   2> 1261961 INFO  (coreCloseExecutor-6122-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@a116021: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@40c25eeb
   [junit4]   2> 1261967 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1bd2454{/solr,null,UNAVAILABLE}
   [junit4]   2> 1261967 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@10eb2688{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1261967 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=91728654
   [junit4]   2> 1261967 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1261967 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@cf3b1b3: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@75587a92
   [junit4]   2> 1261971 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1261971 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@513bda0e: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7ea7087c
   [junit4]   2> 1261974 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1261974 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@55dcefbd: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@22f4708c
   [junit4]   2> 1261974 INFO  (coreCloseExecutor-6124-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6fcd33fd
   [junit4]   2> 1261975 INFO  (coreCloseExecutor-6124-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1875719165
   [junit4]   2> 1261975 INFO  (coreCloseExecutor-6124-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@717947f7: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@3b532e65
   [junit4]   2> 1261982 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[AA28E36B9A89E8A0]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@459e19dc{/solr,null,UNAVAILABLE}
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_AA28E36B9A89E8A0-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@137b9235), locale=es-CR, timezone=Etc/GMT0
   [junit4]   2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=176824272,total=531628032
   [junit4]   2> NOTE: All tests run in this JVM: [MigrateRouteKeyTest, FieldAnalysisRequestHandlerTest, TestNumericRangeQuery64, TestSolrCoreProperties, CustomCollectionTest, PluginInfoTest, CollectionReloadTest, TestRawTransformer, LoggingHandlerTest, TestExtendedDismaxParser, TestCloudDeleteByQuery, SmileWriterTest, CollectionsAPIAsyncDistributedZkTest, TestHashQParserPlugin, TestSolrCloudWithSecureImpersonation, FullSolrCloudDistribCmdsTest, RequiredFieldsTest, QueryElevationComponentTest, ClusterStateTest, TestPivotHelperCode, NodeMutatorTest, TestRequestForwarding, TestCustomStream, TestQuerySenderListener, DistributedFacetPivotLargeTest, SpatialHeatmapFacetsTest, TestZkChroot, TestRTimerTree, IgnoreCommitOptimizeUpdateProcessorFactoryTest, IndexBasedSpellCheckerTest, SSLMigrationTest, ReturnFieldsTest, HdfsRecoverLeaseTest, TestBackupRepositoryFactory, TestMacroExpander, TestMiniSolrCloudClusterSSL, TestCoreDiscovery, TestSegmentSorting, LargeFieldTest, SolrShardReporterTest, TestComplexPhraseLeadingWildcard, ScriptEngineTest, SortByFunctionTest, AnalyticsMergeStrategyTest, TolerantUpdateProcessorTest, CopyFieldTest, TestLMDirichletSimilarityFactory, SparseHLLTest, TestFunctionQuery, DirectSolrSpellCheckerTest, AtomicUpdatesTest, AsyncCallRequestStatusResponseTest, TestExactSharedStatsCache, ConfigSetsAPITest, TestSolrCoreSnapshots, TestDistributedMissingSort, TestSolrFieldCacheBean, SuggesterWFSTTest, TestIndexSearcher, TestFieldCacheVsDocValues, AutoAddReplicasPlanActionTest, NodeAddedTriggerTest, TestConfigSetProperties, HdfsUnloadDistributedZkTest, TestCoreContainer, RecoveryZkTest, TestTolerantSearch, TestCSVResponseWriter, TestDFISimilarityFactory, DisMaxRequestHandlerTest, TestRealTimeGet, TestNoOpRegenerator, SegmentsInfoRequestHandlerTest, TestFieldCacheReopen, FullHLLTest, HdfsLockFactoryTest, CoreAdminRequestStatusTest, TestCollectionAPIs, TestEmbeddedSolrServerConstructors, SolrCloudExampleTest, TestConfigSetsAPIZkFailure, DefaultValueUpdateProcessorTest, FileBasedSpellCheckerTest, TestCollectionsAPIViaSolrCloudCluster, TestJsonFacetRefinement, TestCloudPivotFacet, BlobRepositoryCloudTest, ExecutePlanActionTest, TestSolrCloudWithHadoopAuthPlugin, GraphQueryTest, SystemInfoHandlerTest, TestCharFilters, SolrMetricManagerTest, TestHdfsCloudBackupRestore, MoveReplicaHDFSTest, HighlighterTest, TestLegacyField, TestReloadDeadlock, ImplicitSnitchTest, SuggesterTest, TestManagedSchemaThreadSafety, SharedFSAutoReplicaFailoverTest, TestDistribDocBasedVersion, ResponseHeaderTest, TestAnalyzeInfixSuggestions, XmlUpdateRequestHandlerTest, TestReplicationHandlerBackup, V2StandaloneTest, TestRestManager, TestSolrDeletionPolicy2, CdcrReplicationDistributedZkTest, DistributedQueryComponentOptimizationTest, SolrTestCaseJ4Test, TestSolrConfigHandler, TestDistributedStatsComponentCardinality, TestPayloadScoreQParserPlugin, TestInfoStreamLogging, TestGroupingSearch, BasicDistributedZk2Test, UnloadDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, TestReplicationHandler]
   [junit4] Completed [333/747 (2!)] on J2 in 95.57s, 16 tests, 1 error, 1 skipped <<< FAILURES!

[...truncated 48556 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20803 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20803/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseConcMarkSweepGC

7 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCloudDeleteByQuery

Error Message:
Error from server at http://127.0.0.1:34015/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34015/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([FCF8DB706E999D8F]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.cloud.TestCloudDeleteByQuery.createMiniSolrCloudCluster(TestCloudDeleteByQuery.java:111)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCloudDeleteByQuery

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([FCF8DB706E999D8F]:0)
	at org.apache.solr.cloud.TestCloudDeleteByQuery.afterClass(TestCloudDeleteByQuery.java:87)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.MigrateRouteKeyTest.multipleShardMigrateTest

Error Message:
Error from server at http://127.0.0.1:40849/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40849/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([FCF8DB706E999D8F:E0E8C10A4F592D6E]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.cloud.MigrateRouteKeyTest.multipleShardMigrateTest(MigrateRouteKeyTest.java:89)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.ReplaceNodeTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([FCF8DB706E999D8F:74ACE4AAC065F077]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.ReplaceNodeTest.test(ReplaceNodeTest.java:102)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testIndexOptimization

Error Message:
Error from server at http://127.0.0.1:40305/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40305/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([FCF8DB706E999D8F:F6DBED8D6AC4D5C3]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testIndexOptimization(TestSolrCoreSnapshots.java:178)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testBackupRestore

Error Message:
Error from server at http://127.0.0.1:40305/solr: Could not fully create collection: SolrCoreSnapshots

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40305/solr: Could not fully create collection: SolrCoreSnapshots
	at __randomizedtesting.SeedInfo.seed([FCF8DB706E999D8F:4A43DBCE5C2A53C1]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testBackupRestore(TestSolrCoreSnapshots.java:87)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.component.SearchHandlerTest.testZkConnected

Error Message:
Error from server at https://127.0.0.1:36579/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:36579/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([FCF8DB706E999D8F:3EE046CCF529EDAE]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.handler.component.SearchHandlerTest.testZkConnected(SearchHandlerTest.java:128)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11800 lines...]
   [junit4] Suite: org.apache.solr.core.snapshots.TestSolrCoreSnapshots
   [junit4]   2> 107848 INFO  (SUITE-TestSolrCoreSnapshots-seed#[FCF8DB706E999D8F]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCoreSnapshots_FCF8DB706E999D8F-001/init-core-data-001
   [junit4]   2> 107848 WARN  (SUITE-TestSolrCoreSnapshots-seed#[FCF8DB706E999D8F]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=43 numCloses=43
   [junit4]   2> 107848 INFO  (SUITE-TestSolrCoreSnapshots-seed#[FCF8DB706E999D8F]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 107850 INFO  (SUITE-TestSolrCoreSnapshots-seed#[FCF8DB706E999D8F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 107851 INFO  (SUITE-TestSolrCoreSnapshots-seed#[FCF8DB706E999D8F]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCoreSnapshots_FCF8DB706E999D8F-001/tempDir-001
   [junit4]   2> 107851 INFO  (SUITE-TestSolrCoreSnapshots-seed#[FCF8DB706E999D8F]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 107853 INFO  (Thread-86) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 107853 INFO  (Thread-86) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 107866 ERROR (Thread-86) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 107953 INFO  (SUITE-TestSolrCoreSnapshots-seed#[FCF8DB706E999D8F]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:42021
   [junit4]   2> 107962 INFO  (jetty-launcher-2337-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 107965 INFO  (jetty-launcher-2337-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1cc38ea{/solr,null,AVAILABLE}
   [junit4]   2> 107969 INFO  (jetty-launcher-2337-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@19d6822{HTTP/1.1,[http/1.1]}{127.0.0.1:40305}
   [junit4]   2> 107969 INFO  (jetty-launcher-2337-thread-1) [    ] o.e.j.s.Server Started @109348ms
   [junit4]   2> 107969 INFO  (jetty-launcher-2337-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40305}
   [junit4]   2> 107970 ERROR (jetty-launcher-2337-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 107970 INFO  (jetty-launcher-2337-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 107970 INFO  (jetty-launcher-2337-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 107970 INFO  (jetty-launcher-2337-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 107970 INFO  (jetty-launcher-2337-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-02T11:03:15.316Z
   [junit4]   2> 107973 INFO  (jetty-launcher-2337-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 108048 INFO  (jetty-launcher-2337-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42021/solr
   [junit4]   2> 108209 INFO  (jetty-launcher-2337-thread-1) [n:127.0.0.1:40305_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 108210 INFO  (jetty-launcher-2337-thread-1) [n:127.0.0.1:40305_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40305_solr
   [junit4]   2> 108211 INFO  (jetty-launcher-2337-thread-1) [n:127.0.0.1:40305_solr    ] o.a.s.c.Overseer Overseer (id=98934495327027203-127.0.0.1:40305_solr-n_0000000000) starting
   [junit4]   2> 108230 INFO  (jetty-launcher-2337-thread-1) [n:127.0.0.1:40305_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40305_solr
   [junit4]   2> 108244 INFO  (zkCallback-2344-thread-1-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 108521 INFO  (jetty-launcher-2337-thread-1) [n:127.0.0.1:40305_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40305.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@157fcc8
   [junit4]   2> 108550 INFO  (jetty-launcher-2337-thread-1) [n:127.0.0.1:40305_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40305.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@157fcc8
   [junit4]   2> 108550 INFO  (jetty-launcher-2337-thread-1) [n:127.0.0.1:40305_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40305.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@157fcc8
   [junit4]   2> 108551 INFO  (jetty-launcher-2337-thread-1) [n:127.0.0.1:40305_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCoreSnapshots_FCF8DB706E999D8F-001/tempDir-001/node1/.
   [junit4]   2> 108608 INFO  (SUITE-TestSolrCoreSnapshots-seed#[FCF8DB706E999D8F]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 108610 INFO  (SUITE-TestSolrCoreSnapshots-seed#[FCF8DB706E999D8F]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42021/solr ready
   [junit4]   2> 108618 INFO  (TEST-TestSolrCoreSnapshots.testIndexOptimization-seed#[FCF8DB706E999D8F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testIndexOptimization
   [junit4]   2> 108625 INFO  (qtp24787982-8650) [n:127.0.0.1:40305_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=SolrCoreSnapshots_IndexOptimization&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 108631 INFO  (OverseerThreadFactory-796-thread-1-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.CreateCollectionCmd Create collection SolrCoreSnapshots_IndexOptimization
   [junit4]   2> 108744 INFO  (OverseerStateUpdate-98934495327027203-127.0.0.1:40305_solr-n_0000000000) [n:127.0.0.1:40305_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SolrCoreSnapshots_IndexOptimization",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"SolrCoreSnapshots_IndexOptimization_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:40305/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 108948 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=SolrCoreSnapshots_IndexOptimization_shard1_replica_n1&action=CREATE&numShards=1&collection=SolrCoreSnapshots_IndexOptimization&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 108948 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 109058 INFO  (zkCallback-2344-thread-1-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCoreSnapshots_IndexOptimization/state.json] for collection [SolrCoreSnapshots_IndexOptimization] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 109058 INFO  (zkCallback-2344-thread-2-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCoreSnapshots_IndexOptimization/state.json] for collection [SolrCoreSnapshots_IndexOptimization] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 109984 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 110056 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.s.IndexSchema [SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 110063 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 110063 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'SolrCoreSnapshots_IndexOptimization_shard1_replica_n1' using configuration from collection SolrCoreSnapshots_IndexOptimization, trusted=true
   [junit4]   2> 110065 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40305.solr.core.SolrCoreSnapshots_IndexOptimization.shard1.replica_n1' (registry 'solr.core.SolrCoreSnapshots_IndexOptimization.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@157fcc8
   [junit4]   2> 110077 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 110078 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SolrCore [[SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCoreSnapshots_FCF8DB706E999D8F-001/tempDir-001/node1/SolrCoreSnapshots_IndexOptimization_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCoreSnapshots_FCF8DB706E999D8F-001/tempDir-001/node1/./SolrCoreSnapshots_IndexOptimization_shard1_replica_n1/data/]
   [junit4]   2> 110237 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 110237 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 110239 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 110239 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 110242 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@a9709e[SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] main]
   [junit4]   2> 110243 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 110244 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 110245 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 110253 INFO  (searcherExecutor-799-thread-1-processing-n:127.0.0.1:40305_solr x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1 s:shard1 c:SolrCoreSnapshots_IndexOptimization r:core_node2) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SolrCore [SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] Registered new searcher Searcher@a9709e[SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 110253 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582951927747969024
   [junit4]   2> 110258 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 110258 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 110258 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40305/solr/SolrCoreSnapshots_IndexOptimization_shard1_replica_n1/
   [junit4]   2> 110258 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 110258 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:40305/solr/SolrCoreSnapshots_IndexOptimization_shard1_replica_n1/ has no replicas
   [junit4]   2> 110258 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 110262 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40305/solr/SolrCoreSnapshots_IndexOptimization_shard1_replica_n1/ shard1
   [junit4]   2> 288628 ERROR (qtp24787982-8650) [n:127.0.0.1:40305_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: create the collection time out:180s
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 288629 INFO  (qtp24787982-8650) [n:127.0.0.1:40305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=SolrCoreSnapshots_IndexOptimization&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=500 QTime=180003
   [junit4]   2> 288629 ERROR (qtp24787982-8650) [n:127.0.0.1:40305_solr    ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: create the collection time out:180s
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 288630 INFO  (TEST-TestSolrCoreSnapshots.testIndexOptimization-seed#[FCF8DB706E999D8F]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testIndexOptimization
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrCoreSnapshots -Dtests.method=testIndexOptimization -Dtests.seed=FCF8DB706E999D8F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pt-BR -Dtests.timezone=America/Kentucky/Louisville -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR    180s J2 | TestSolrCoreSnapshots.testIndexOptimization <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40305/solr: create the collection time out:180s
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FCF8DB706E999D8F:F6DBED8D6AC4D5C3]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
   [junit4]    > 	at org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testIndexOptimization(TestSolrCoreSnapshots.java:178)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 288636 INFO  (TEST-TestSolrCoreSnapshots.testBackupRestore-seed#[FCF8DB706E999D8F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBackupRestore
   [junit4]   2> 288637 INFO  (qtp24787982-8648) [n:127.0.0.1:40305_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=SolrCoreSnapshots&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 288639 INFO  (OverseerThreadFactory-796-thread-2-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.CreateCollectionCmd Create collection SolrCoreSnapshots
   [junit4]   2> 318729 ERROR (OverseerThreadFactory-796-thread-2-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.OverseerCollectionMessageHandler Collection: SolrCoreSnapshots operation: create failed:org.apache.solr.common.SolrException: Could not fully create collection: SolrCoreSnapshots
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:215)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 318739 INFO  (qtp24787982-8648) [n:127.0.0.1:40305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=SolrCoreSnapshots&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=500 QTime=30102
   [junit4]   2> 318740 ERROR (qtp24787982-8648) [n:127.0.0.1:40305_solr    ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Could not fully create collection: SolrCoreSnapshots
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:307)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 318741 INFO  (TEST-TestSolrCoreSnapshots.testBackupRestore-seed#[FCF8DB706E999D8F]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBackupRestore
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrCoreSnapshots -Dtests.method=testBackupRestore -Dtests.seed=FCF8DB706E999D8F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pt-BR -Dtests.timezone=America/Kentucky/Louisville -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   30.1s J2 | TestSolrCoreSnapshots.testBackupRestore <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40305/solr: Could not fully create collection: SolrCoreSnapshots
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FCF8DB706E999D8F:4A43DBCE5C2A53C1]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
   [junit4]    > 	at org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testBackupRestore(TestSolrCoreSnapshots.java:87)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 318749 INFO  (jetty-closer-2338-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@19d6822{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 318749 INFO  (jetty-closer-2338-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=23043998
   [junit4]   2> 318750 INFO  (jetty-closer-2338-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 318750 INFO  (jetty-closer-2338-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@15bc1a4: rootName = solr_40305, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1b29eeb
   [junit4]   2> 318751 ERROR (OverseerThreadFactory-796-thread-1-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:40305/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:40305/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:40305 failed to respond
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 318753 ERROR (OverseerThreadFactory-796-thread-1-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [SolrCoreSnapshots_IndexOptimization].
   [junit4]   2> 318754 INFO  (OverseerThreadFactory-796-thread-1-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 318755 ERROR (OverseerThreadFactory-796-thread-1-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:40305/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:40305/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:650)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:40305 [/127.0.0.1] failed: Connection refused (Connection refused)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
   [junit4]   2> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
   [junit4]   2> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]   2> 	at java.net.Socket.connect(Socket.java:589)
   [junit4]   2> 	at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
   [junit4]   2> 	... 22 more
   [junit4]   2> 318772 INFO  (jetty-closer-2338-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 318772 INFO  (jetty-closer-2338-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1bd40fd: rootName = solr_40305, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4b6185
   [junit4]   2> 318781 INFO  (jetty-closer-2338-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 318781 INFO  (jetty-closer-2338-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@107c743: rootName = solr_40305, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@92746d
   [junit4]   2> 318783 INFO  (jetty-closer-2338-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40305_solr
   [junit4]   2> 318783 INFO  (jetty-closer-2338-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 318783 INFO  (zkCallback-2344-thread-5-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 318784 INFO  (coreCloseExecutor-804-thread-1) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SolrCore [SolrCoreSnapshots_IndexOptimization_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@d1d077
   [junit4]   2> 318784 INFO  (coreCloseExecutor-804-thread-1) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.SolrCoreSnapshots_IndexOptimization.shard1.replica_n1, tag=13750391
   [junit4]   2> 318784 INFO  (coreCloseExecutor-804-thread-1) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@115361d: rootName = solr_40305, domain = solr.core.SolrCoreSnapshots_IndexOptimization.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.SolrCoreSnapshots_IndexOptimization.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@1e9fe75
   [junit4]   2> 318794 INFO  (coreCloseExecutor-804-thread-1) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.SolrCoreSnapshots_IndexOptimization.shard1.leader, tag=13750391
   [junit4]   2> 318797 INFO  (jetty-closer-2338-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98934495327027203-127.0.0.1:40305_solr-n_0000000000) closing
   [junit4]   2> 318797 INFO  (OverseerStateUpdate-98934495327027203-127.0.0.1:40305_solr-n_0000000000) [n:127.0.0.1:40305_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40305_solr
   [junit4]   2> 348820 INFO  (zkCallback-2344-thread-5-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/SolrCoreSnapshots_IndexOptimization/state.json] for collection [SolrCoreSnapshots_IndexOptimization] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 348820 INFO  (zkCallback-2344-thread-6-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/SolrCoreSnapshots_IndexOptimization/state.json] for collection [SolrCoreSnapshots_IndexOptimization] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 348824 ERROR (OverseerThreadFactory-796-thread-1-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.OverseerCollectionMessageHandler Collection: SolrCoreSnapshots_IndexOptimization operation: create failed:org.apache.solr.common.SolrException: Could not fully remove collection: SolrCoreSnapshots_IndexOptimization
   [junit4]   2> 	at org.apache.solr.cloud.DeleteCollectionCmd.call(DeleteCollectionCmd.java:109)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.cleanupCollection(OverseerCollectionMessageHandler.java:678)
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:302)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 348826 INFO  (OverseerThreadFactory-796-thread-1-processing-n:127.0.0.1:40305_solr) [n:127.0.0.1:40305_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 348827 WARN  (OverseerAutoScalingTriggerThread-98934495327027203-127.0.0.1:40305_solr-n_0000000000) [n:127.0.0.1:40305_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 348829 INFO  (jetty-closer-2338-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1cc38ea{/solr,null,UNAVAILABLE}
   [junit4]   2> 348857 ERROR (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ZkController Error getting leader from zk
   [junit4]   2> org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: SolrCoreSnapshots_IndexOptimization slice: shard1 saw state=null with live_nodes=[]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:816)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:781)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:890)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1050)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 348858 ERROR (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ZkContainer :org.apache.solr.common.SolrException: Error getting leader from zk for shard shard1
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1207)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:890)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1050)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: SolrCoreSnapshots_IndexOptimization slice: shard1 saw state=null with live_nodes=[]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:816)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:781)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
   [junit4]   2> 	... 41 more
   [junit4]   2> 
   [junit4]   2> 348859 INFO  (qtp24787982-8649) [n:127.0.0.1:40305_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=n

[...truncated too long message...]

stry=solr.collection.replacenodetest_coll.shard3.leader, tag=17526717
   [junit4]   2> 2240140 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f7c8670dd0009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2240141 INFO  (jetty-closer-2412-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@13fbf96{/solr,null,UNAVAILABLE}
   [junit4]   2> 2240142 INFO  (jetty-closer-2412-thread-6) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@8a343e{/solr,null,UNAVAILABLE}
   [junit4]   2> 2255585 ERROR (OverseerThreadFactory-7776-thread-2-processing-n:127.0.0.1:41155_solr) [n:127.0.0.1:41155_solr    ] o.a.s.c.OverseerCollectionMessageHandler Operation replacenode failed:org.apache.solr.common.SolrException: Timed out waiting to see all replicas: [replacenodetest_coll_shard4_replica_t23] in cluster state.
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.waitToSeeReplicasInState(OverseerCollectionMessageHandler.java:704)
   [junit4]   2> 	at org.apache.solr.cloud.AddReplicaCmd.addReplica(AddReplicaCmd.java:173)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.addReplica(OverseerCollectionMessageHandler.java:714)
   [junit4]   2> 	at org.apache.solr.cloud.ReplaceNodeCmd.call(ReplaceNodeCmd.java:106)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 2255590 INFO  (OverseerThreadFactory-7776-thread-2-processing-n:127.0.0.1:41155_solr) [n:127.0.0.1:41155_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2255590 WARN  (OverseerAutoScalingTriggerThread-98934633686433808-127.0.0.1:41155_solr-n_0000000000) [n:127.0.0.1:41155_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 2255595 INFO  (jetty-closer-2412-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@669ced{/solr,null,UNAVAILABLE}
   [junit4]   2> 2255595 ERROR (SUITE-ReplaceNodeTest-seed#[FCF8DB706E999D8F]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2255596 INFO  (SUITE-ReplaceNodeTest-seed#[FCF8DB706E999D8F]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38055 38055
   [junit4]   2> 2255630 INFO  (Thread-3906) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38055 38055
   [junit4]   2> 2255631 WARN  (Thread-3906) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/aliases.json
   [junit4]   2> 	7	/solr/clusterprops.json
   [junit4]   2> 	6	/solr/security.json
   [junit4]   2> 	6	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	33	/solr/collections/replacenodetest_coll/state.json
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/overseer_elect/election/98934633686433808-127.0.0.1:41155_solr-n_0000000000
   [junit4]   2> 	2	/solr/collections/replacenodetest_coll/leader_elect/shard1/election/98934633686433806-core_node2-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/98934633686433801-127.0.0.1:37497_solr-n_0000000002
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/live_nodes
   [junit4]   2> 	7	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeTest_FCF8DB706E999D8F-001
   [junit4]   2> Nov 02, 2017 11:39:02 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1626, maxMBSortInHeap=7.548453052430535, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4d1f92), locale=sr-ME, timezone=Africa/Ceuta
   [junit4]   2> NOTE: Linux 4.10.0-37-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=233709192,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestScoreJoinQPScore, DeleteReplicaTest, TestSolrIndexConfig, SimpleFacetsTest, TestQueryUtils, MinimalSchemaTest, TestSuggestSpellingConverter, JsonLoaderTest, DocumentBuilderTest, SolrMetricReporterTest, TestXmlQParser, DistributedExpandComponentTest, SimpleCollectionCreateDeleteTest, DirectUpdateHandlerOptimizeTest, RestartWhileUpdatingTest, TestHighlightDedupGrouping, TestRandomDVFaceting, TestSolr4Spatial2, TestFieldTypeCollectionResource, BasicZkTest, StatsReloadRaceTest, BaseCdcrDistributedZkTest, TestTlogReplica, SolrInfoBeanTest, TestNumericTerms64, DistributedMLTComponentTest, MetricsConfigTest, CacheHeaderTest, TestPushWriter, HdfsBasicDistributedZkTest, BitVectorTest, SliceStateTest, TestCloudInspectUtil, TestMergePolicyConfig, DistributedQueueTest, RemoteQueryErrorTest, TestEmbeddedSolrServerSchemaAPI, TestOnReconnectListenerSupport, SyncSliceTest, SaslZkACLProviderTest, ReplicaListTransformerTest, MetricUtilsTest, TestGeoJSONResponseWriter, TestOverriddenPrefixQueryForCustomFieldType, TestIBSimilarityFactory, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestUseDocValuesAsStored, TestManagedResource, CursorPagingTest, TestShardHandlerFactory, TestPullReplicaErrorHandling, ActionThrottleTest, TestLuceneIndexBackCompat, CollectionsAPISolrJTest, TestInitParams, TestTrackingShardHandlerFactory, DeleteInactiveReplicaTest, TestReRankQParserPlugin, TestPointFields, TestStandardQParsers, TestJoin, TemplateUpdateProcessorTest, ExternalFileFieldSortTest, TestRetrieveFieldsOptimizer, NoCacheHeaderTest, RAMDirectoryFactoryTest, CollectionStateFormat2Test, BooleanFieldTest, TestExpandComponent, TestDistributedSearch, TestFilteredDocIdSet, SpellCheckCollatorTest, TestConfigsApi, HdfsDirectoryFactoryTest, WrapperMergePolicyFactoryTest, PeerSyncTest, TestInitQParser, MergeStrategyTest, TlogReplayBufferedWhileIndexingTest, TestLocalFSCloudBackupRestore, TestReversedWildcardFilterFactory, SpellCheckComponentTest, TestWordDelimiterFilterFactory, TestSortByMinMaxFunction, TestNumericTokenStream, TestUpdate, OverseerModifyCollectionTest, TestRandomFaceting, TestJsonFacets, CloneFieldUpdateProcessorFactoryTest, TestDynamicFieldResource, LeaderElectionContextKeyTest, TestFieldCacheWithThreads, TestSolrCLIRunExample, TestSolrDeletionPolicy1, TestPolicyCloud, ConjunctionSolrSpellCheckerTest, TestCloudPseudoReturnFields, AddSchemaFieldsUpdateProcessorFactoryTest, TestUtils, TestBadConfig, TestExceedMaxTermLength, TestSolrCloudWithDelegationTokens, TestReplicationHandler, TestRebalanceLeaders, TestStressVersions, ParsingFieldUpdateProcessorsTest, TestConfigReload, AnalyticsQueryTest, TestReqParamsAPI, TestSQLHandlerNonCloud, PropertiesRequestHandlerTest, TestStressCloudBlindAtomicUpdates, TestCloudNestedDocsSort, SolrCoreTest, BufferStoreTest, TestDefaultStatsCache, TestUnifiedSolrHighlighter, PeerSyncWithIndexFingerprintCachingTest, FastVectorHighlighterTest, SolrPluginUtilsTest, TestShortCircuitedRequests, DateRangeFieldTest, BasicDistributedZkTest, LeaderElectionIntegrationTest, ShardRoutingTest, LeaderElectionTest, ZkCLITest, ShardRoutingCustomTest, TestRecovery, DistributedTermsComponentTest, TestSolr4Spatial, StatsComponentTest, TestSort, BasicFunctionalityTest, TestLazyCores, SoftAutoCommitTest, TestLFUCache, UpdateParamsTest, TestQuerySenderNoQuery, CopyFieldTest, ResponseLogComponentTest, TestStressRecovery, MultiTermTest, TestDocSet, TestBinaryField, TestSearchPerf, NumericFieldsTest, TestElisionMultitermQuery, TestConfig, TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, TestPostingsSolrHighlighter, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestFastWriter, TimeZoneUtilsTest, ResourceLoaderTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, AddReplicaTest, AssignTest, AsyncCallRequestStatusResponseTest, CollectionsAPIAsyncDistributedZkTest, DistribJoinFromCollectionTest, DocValuesNotIndexedTest, HealthCheckHandlerTest, LeaderInitiatedRecoveryOnCommitTest, MoveReplicaHDFSTest, OverriddenZkACLAndCredentialsProvidersTest, ReplaceNodeTest]
   [junit4] Completed [544/747 (5!)] on J0 in 36.82s, 1 test, 1 failure <<< FAILURES!

[...truncated 43692 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20802 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20802/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseParallelGC

2 tests failed.
FAILED:  org.apache.solr.client.solrj.request.TestV1toV2ApiMapper.testCommands

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([BB10016FF516E93:2A8DC9EE956B8EF7]:0)
	at org.apache.solr.client.solrj.request.TestV1toV2ApiMapper.testCommands(TestV1toV2ApiMapper.java:38)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.CleanupOldIndexTest.test

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
	at __randomizedtesting.SeedInfo.seed([C8A9514A51E1A0D6:40FD6E90FF1DCD2E]:0)
	at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:440)
	at org.apache.solr.cloud.CleanupOldIndexTest.test(CleanupOldIndexTest.java:114)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12392 lines...]
   [junit4] Suite: org.apache.solr.cloud.CleanupOldIndexTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_C8A9514A51E1A0D6-001/init-core-data-001
   [junit4]   2> 136613 WARN  (SUITE-CleanupOldIndexTest-seed#[C8A9514A51E1A0D6]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2447 numCloses=2447
   [junit4]   2> 136613 INFO  (SUITE-CleanupOldIndexTest-seed#[C8A9514A51E1A0D6]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 136615 INFO  (SUITE-CleanupOldIndexTest-seed#[C8A9514A51E1A0D6]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 136615 INFO  (SUITE-CleanupOldIndexTest-seed#[C8A9514A51E1A0D6]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 136615 INFO  (SUITE-CleanupOldIndexTest-seed#[C8A9514A51E1A0D6]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_C8A9514A51E1A0D6-001/tempDir-001
   [junit4]   2> 136615 INFO  (SUITE-CleanupOldIndexTest-seed#[C8A9514A51E1A0D6]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 136617 INFO  (Thread-79) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 136617 INFO  (Thread-79) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 136619 ERROR (Thread-79) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 136717 INFO  (SUITE-CleanupOldIndexTest-seed#[C8A9514A51E1A0D6]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:35003
   [junit4]   2> 136721 INFO  (jetty-launcher-125-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 136721 INFO  (jetty-launcher-125-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 136726 INFO  (jetty-launcher-125-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6e49df{/solr,null,AVAILABLE}
   [junit4]   2> 136726 INFO  (jetty-launcher-125-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a9ac1c{/solr,null,AVAILABLE}
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@34908d{HTTP/1.1,[http/1.1]}{127.0.0.1:45305}
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@284d09{HTTP/1.1,[http/1.1]}{127.0.0.1:41983}
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-2) [    ] o.e.j.s.Server Started @138452ms
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-1) [    ] o.e.j.s.Server Started @138452ms
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45305}
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41983}
   [junit4]   2> 136727 ERROR (jetty-launcher-125-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 136727 ERROR (jetty-launcher-125-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-02T07:53:53.353Z
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 136727 INFO  (jetty-launcher-125-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-02T07:53:53.353Z
   [junit4]   2> 136733 INFO  (jetty-launcher-125-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 136733 INFO  (jetty-launcher-125-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 136741 INFO  (jetty-launcher-125-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35003/solr
   [junit4]   2> 136748 INFO  (jetty-launcher-125-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35003/solr
   [junit4]   2> 136825 INFO  (jetty-launcher-125-thread-2) [n:127.0.0.1:45305_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 136825 INFO  (jetty-launcher-125-thread-2) [n:127.0.0.1:45305_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45305_solr
   [junit4]   2> 136826 INFO  (jetty-launcher-125-thread-2) [n:127.0.0.1:45305_solr    ] o.a.s.c.Overseer Overseer (id=98933750709878790-127.0.0.1:45305_solr-n_0000000000) starting
   [junit4]   2> 136855 INFO  (jetty-launcher-125-thread-1) [n:127.0.0.1:41983_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 136867 INFO  (jetty-launcher-125-thread-2) [n:127.0.0.1:45305_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45305_solr
   [junit4]   2> 136881 INFO  (jetty-launcher-125-thread-1) [n:127.0.0.1:41983_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41983_solr
   [junit4]   2> 136882 INFO  (zkCallback-137-thread-1-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 136895 INFO  (zkCallback-136-thread-1-processing-n:127.0.0.1:41983_solr) [n:127.0.0.1:41983_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 137017 INFO  (jetty-launcher-125-thread-1) [n:127.0.0.1:41983_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41983.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512e7c
   [junit4]   2> 137018 INFO  (jetty-launcher-125-thread-2) [n:127.0.0.1:45305_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45305.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512e7c
   [junit4]   2> 137023 INFO  (jetty-launcher-125-thread-1) [n:127.0.0.1:41983_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41983.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512e7c
   [junit4]   2> 137023 INFO  (jetty-launcher-125-thread-1) [n:127.0.0.1:41983_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41983.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512e7c
   [junit4]   2> 137023 INFO  (jetty-launcher-125-thread-2) [n:127.0.0.1:45305_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45305.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512e7c
   [junit4]   2> 137024 INFO  (jetty-launcher-125-thread-2) [n:127.0.0.1:45305_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45305.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512e7c
   [junit4]   2> 137024 INFO  (jetty-launcher-125-thread-1) [n:127.0.0.1:41983_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_C8A9514A51E1A0D6-001/tempDir-001/node1/.
   [junit4]   2> 137024 INFO  (jetty-launcher-125-thread-2) [n:127.0.0.1:45305_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_C8A9514A51E1A0D6-001/tempDir-001/node2/.
   [junit4]   2> 137054 INFO  (SUITE-CleanupOldIndexTest-seed#[C8A9514A51E1A0D6]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 137054 INFO  (SUITE-CleanupOldIndexTest-seed#[C8A9514A51E1A0D6]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35003/solr ready
   [junit4]   2> 137061 INFO  (TEST-CleanupOldIndexTest.test-seed#[C8A9514A51E1A0D6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 137063 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=b757d9c3-88bc-41e9-803a-74b63ee257a2&replicationFactor=2&collection.configName=conf1&name=oldindextest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 137064 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=b757d9c3-88bc-41e9-803a-74b63ee257a2&replicationFactor=2&collection.configName=conf1&name=oldindextest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 137065 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 137065 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 137067 INFO  (OverseerThreadFactory-301-thread-1-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.CreateCollectionCmd Create collection oldindextest
   [junit4]   2> 137174 INFO  (OverseerStateUpdate-98933750709878790-127.0.0.1:45305_solr-n_0000000000) [n:127.0.0.1:45305_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"oldindextest",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"oldindextest_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45305/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 137175 INFO  (OverseerStateUpdate-98933750709878790-127.0.0.1:45305_solr-n_0000000000) [n:127.0.0.1:45305_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"oldindextest",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"oldindextest_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:41983/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 137379 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867&coreNodeName=core_node4&name=oldindextest_shard1_replica_n2&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=1
   [junit4]   2> 137379 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867&coreNodeName=core_node4&name=oldindextest_shard1_replica_n2&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 137380 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 137383 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&coreNodeName=core_node3&name=oldindextest_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=4
   [junit4]   2> 137400 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&coreNodeName=core_node3&name=oldindextest_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 137401 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 137404 INFO  (qtp11312388-547) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 137404 INFO  (qtp11312388-547) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 137506 INFO  (zkCallback-137-thread-1-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 137506 INFO  (zkCallback-136-thread-1-processing-n:127.0.0.1:41983_solr) [n:127.0.0.1:41983_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 137506 INFO  (zkCallback-136-thread-2-processing-n:127.0.0.1:41983_solr) [n:127.0.0.1:41983_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 137506 INFO  (zkCallback-137-thread-2-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 138066 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 138067 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 138405 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 138405 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 138412 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 138412 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 138418 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.s.IndexSchema [oldindextest_shard1_replica_n2] Schema name=cloud-dynamic
   [junit4]   2> 138418 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.s.IndexSchema [oldindextest_shard1_replica_n1] Schema name=cloud-dynamic
   [junit4]   2> 138438 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 138438 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'oldindextest_shard1_replica_n2' using configuration from collection oldindextest, trusted=true
   [junit4]   2> 138438 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 138438 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'oldindextest_shard1_replica_n1' using configuration from collection oldindextest, trusted=true
   [junit4]   2> 138438 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41983.solr.core.oldindextest.shard1.replica_n2' (registry 'solr.core.oldindextest.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512e7c
   [junit4]   2> 138438 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45305.solr.core.oldindextest.shard1.replica_n1' (registry 'solr.core.oldindextest.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512e7c
   [junit4]   2> 138442 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 138442 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 138442 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SolrCore [[oldindextest_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_C8A9514A51E1A0D6-001/tempDir-001/node1/oldindextest_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_C8A9514A51E1A0D6-001/tempDir-001/node1/./oldindextest_shard1_replica_n2/data/]
   [junit4]   2> 138442 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrCore [[oldindextest_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_C8A9514A51E1A0D6-001/tempDir-001/node2/oldindextest_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_C8A9514A51E1A0D6-001/tempDir-001/node2/./oldindextest_shard1_replica_n1/data/]
   [junit4]   2> 138496 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 138496 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 138497 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 138497 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 138498 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 138498 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 138498 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 138499 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 138499 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@4f4d73[oldindextest_shard1_replica_n2] main]
   [junit4]   2> 138499 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 138499 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 138500 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 138500 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b7f0f[oldindextest_shard1_replica_n1] main]
   [junit4]   2> 138500 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 138501 INFO  (searcherExecutor-306-thread-1-processing-x:oldindextest_shard1_replica_n2 r:core_node4 b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE n:127.0.0.1:41983_solr s:shard1 c:oldindextest) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SolrCore [oldindextest_shard1_replica_n2] Registered new searcher Searcher@4f4d73[oldindextest_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 138501 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 138501 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582940013332529152
   [junit4]   2> 138501 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 138502 INFO  (searcherExecutor-307-thread-1-processing-x:oldindextest_shard1_replica_n1 r:core_node3 b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE n:127.0.0.1:45305_solr s:shard1 c:oldindextest) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrCore [oldindextest_shard1_replica_n1] Registered new searcher Searcher@3b7f0f[oldindextest_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 138502 INFO  (parallelCoreAdminExecutor-303-thread-1-processing-n:127.0.0.1:45305_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912 CREATE) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582940013333577728
   [junit4]   2> 138504 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 138504 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 138504 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41983/solr/oldindextest_shard1_replica_n2/
   [junit4]   2> 138504 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=oldindextest_shard1_replica_n2 url=http://127.0.0.1:41983/solr START replicas=[http://127.0.0.1:45305/solr/oldindextest_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 138506 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.S.Request [oldindextest_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 138804 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=oldindextest_shard1_replica_n2 url=http://127.0.0.1:41983/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 138804 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 138804 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 138804 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 138806 INFO  (parallelCoreAdminExecutor-302-thread-1-processing-n:127.0.0.1:41983_solr b757d9c3-88bc-41e9-803a-74b63ee257a2334581971956867 CREATE) [n:127.0.0.1:41983_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41983/solr/oldindextest_shard1_replica_n2/ shard1
   [junit4]   2> 139068 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 139068 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 139406 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 139406 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 140069 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 140070 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 140408 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 140408 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 141071 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 141073 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 141410 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 141410 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 142074 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 142074 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 142411 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 142411 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 143076 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 143076 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 143412 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 143412 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 144077 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 144078 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 144413 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 144413 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 145079 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 145080 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 145414 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 145414 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 146081 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 146081 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 146415 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 146415 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 147082 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 147082 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 147416 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 147417 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 148083 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 148084 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 148418 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 148418 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 149085 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 149086 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 149419 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 149419 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 150087 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 150087 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 150420 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 150420 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 151088 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 151089 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 151421 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 151421 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 152090 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 152091 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 152422 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 152422 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 153092 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 153092 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 153424 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 153424 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 154093 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 154094 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 154425 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 154425 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 155095 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 155095 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 155426 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 155426 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 156097 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 156097 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 156427 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 156427 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 157098 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 157099 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 157428 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 157428 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 158100 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 158100 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 158430 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 158430 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 159101 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 159102 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 159431 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 159431 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 160103 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 160104 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 160432 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 160432 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 161105 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 161105 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 161433 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 161433 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 162106 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 162107 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 162434 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 162434 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 163108 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 163108 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 163435 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 163435 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 164109 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 164110 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 164436 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 164436 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 165111 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 165111 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 165437 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 165437 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 166112 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 166113 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 166438 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 166438 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 167114 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 167117 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 167439 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 167439 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 168118 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 168118 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 168441 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 168441 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 169119 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 169120 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 169442 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 169442 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 170121 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 170121 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 170443 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 170443 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 171122 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 171123 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 171444 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 171444 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 172124 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 172124 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 172445 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 172445 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 173125 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 173126 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 173446 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 173446 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 174127 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 174127 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 174447 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 174447 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 175128 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 175129 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 175448 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 175448 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 176129 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 176130 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 176449 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 176449 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 177131 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 177132 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 177450 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 177450 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 178133 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 178133 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 178451 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 178451 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 179134 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 179135 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 179452 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 179452 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 180136 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 180137 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 180453 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 180453 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 181137 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 181138 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 181454 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 181454 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 182139 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 182140 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 182455 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 182455 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 183141 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 183141 INFO  (qtp25884360-548) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 183456 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 183456 INFO  (qtp11312388-539) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 184142 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 184143 INFO  (qtp25884360-550) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 184457 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 184457 INFO  (qtp11312388-549) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 185144 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 185145 INFO  (qtp25884360-540) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 185458 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 185458 INFO  (qtp11312388-551) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 186146 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 186146 INFO  (qtp25884360-552) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 186459 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912
   [junit4]   2> 186459 INFO  (qtp11312388-537) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b757d9c3-88bc-41e9-803a-74b63ee257a2334581970811912&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTi

[...truncated too long message...]

doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
   [junit4]   2> 	at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1457400 INFO  (qtp25884360-544) [n:127.0.0.1:41983_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:45305_solr&onlyIfLeaderActive=true&core=oldindextest_shard1_replica_n2&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=400 QTime=94048
   [junit4]   2> 1461829 INFO  (recoveryExecutor-148-thread-1-processing-n:127.0.0.1:45305_solr x:oldindextest_shard1_replica_n1 s:shard1 c:oldindextest r:core_node3) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.RecoveryStrategy RecoveryStrategy has been closed
   [junit4]   2> 1461829 INFO  (recoveryExecutor-148-thread-1-processing-n:127.0.0.1:45305_solr x:oldindextest_shard1_replica_n1 s:shard1 c:oldindextest r:core_node3) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[false]
   [junit4]   2> 1461829 INFO  (recoveryExecutor-148-thread-1-processing-n:127.0.0.1:45305_solr x:oldindextest_shard1_replica_n1 s:shard1 c:oldindextest r:core_node3) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrCore [oldindextest_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1b6cce1
   [junit4]   2> 1461829 INFO  (recoveryExecutor-148-thread-1-processing-n:127.0.0.1:45305_solr x:oldindextest_shard1_replica_n1 s:shard1 c:oldindextest r:core_node3) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.oldindextest.shard1.replica_n1, tag=28757217
   [junit4]   2> 1461829 INFO  (recoveryExecutor-148-thread-1-processing-n:127.0.0.1:45305_solr x:oldindextest_shard1_replica_n1 s:shard1 c:oldindextest r:core_node3) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1ce8f98: rootName = solr_45305, domain = solr.core.oldindextest.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.oldindextest.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@16986d0
   [junit4]   2> 1461835 INFO  (recoveryExecutor-148-thread-1-processing-n:127.0.0.1:45305_solr x:oldindextest_shard1_replica_n1 s:shard1 c:oldindextest r:core_node3) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.oldindextest.shard1.leader, tag=28757217
   [junit4]   2> 1461835 WARN  (recoveryExecutor-148-thread-1-processing-n:127.0.0.1:45305_solr x:oldindextest_shard1_replica_n1 s:shard1 c:oldindextest r:core_node3) [n:127.0.0.1:45305_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.RecoveryStrategy Stopping recovery for core=[oldindextest_shard1_replica_n1] coreNodeName=[core_node3]
   [junit4]   2> 1461840 INFO  (jetty-closer-126-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@f32af2{/solr,null,UNAVAILABLE}
   [junit4]   2> 1461840 ERROR (SUITE-CleanupOldIndexTest-seed#[C8A9514A51E1A0D6]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1461841 INFO  (SUITE-CleanupOldIndexTest-seed#[C8A9514A51E1A0D6]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35003 35003
   [junit4]   2> 1461859 INFO  (Thread-79) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35003 35003
   [junit4]   2> 1461859 WARN  (Thread-79) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 	3	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	16	/solr/collections/oldindextest/state.json
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/autoscaling.json
   [junit4]   2> 	2	/solr/collections/oldindextest/leader_elect/shard1/election/98933750709878789-core_node4-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/live_nodes
   [junit4]   2> 	4	/solr/collections
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_C8A9514A51E1A0D6-001
   [junit4]   2> Nov 02, 2017 8:15:58 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=7, maxDocsPerChunk=10, blockSize=930), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=7, blockSize=930)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1c38e72), locale=fr, timezone=Europe/Busingen
   [junit4]   2> NOTE: Linux 4.10.0-37-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=68790720,total=272629760
   [junit4]   2> NOTE: All tests run in this JVM: [UpdateRequestProcessorFactoryTest, SolrCoreTest, SolrGraphiteReporterTest, TestDownShardTolerantSearch, TestIntervalFaceting, TestSubQueryTransformer, AutoscalingHistoryHandlerTest, TestPointFields, CleanupOldIndexTest]
   [junit4] Completed [229/747 (1!)] on J0 in 1326.01s, 1 test, 1 error <<< FAILURES!

[...truncated 2181 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.request.TestV1toV2ApiMapper
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestV1toV2ApiMapper -Dtests.method=testCommands -Dtests.seed=BB10016FF516E93 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-GB -Dtests.timezone=America/Dominica -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.01s J0 | TestV1toV2ApiMapper.testCommands <<<
   [junit4]    > Throwable #1: java.lang.NullPointerException
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([BB10016FF516E93:2A8DC9EE956B8EF7]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.request.TestV1toV2ApiMapper.testCommands(TestV1toV2ApiMapper.java:38)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=178, maxMBSortInHeap=7.280619039016045, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@10f8363), locale=en-GB, timezone=America/Dominica
   [junit4]   2> NOTE: Linux 4.10.0-37-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=157643064,total=228327424
   [junit4]   2> NOTE: All tests run in this JVM: [SolrExampleStreamingTest, StreamExpressionParserTest, ReverseEvaluatorTest, ShardParamsTest, ContentStreamTest, TestV1toV2ApiMapper]
   [junit4] Completed [15/146 (1!)] on J0 in 0.02s, 1 test, 1 error <<< FAILURES!

[...truncated 42525 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20801 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20801/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCloudRecovery

Error Message:
Error from server at https://127.0.0.1:37585/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37585/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([A36D351FE5492D67]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.cloud.TestCloudRecovery.setupCluster(TestCloudRecovery.java:68)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:     1) Thread[id=22781, name=jetty-launcher-1847-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   1) Thread[id=22781, name=jetty-launcher-1847-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
	at __randomizedtesting.SeedInfo.seed([A36D351FE5492D67]:0)


FAILED:  org.apache.solr.cloud.DeleteStatusTest.testProcessAndWaitDeletesAsyncIds

Error Message:
expected same:<COMPLETED> was not:<RUNNING>

Stack Trace:
java.lang.AssertionError: expected same:<COMPLETED> was not:<RUNNING>
	at __randomizedtesting.SeedInfo.seed([A36D351FE5492D67:98734F31B07824C0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotSame(Assert.java:641)
	at org.junit.Assert.assertSame(Assert.java:580)
	at org.junit.Assert.assertSame(Assert.java:593)
	at org.apache.solr.cloud.DeleteStatusTest.testProcessAndWaitDeletesAsyncIds(DeleteStatusTest.java:96)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11862 lines...]
   [junit4] Suite: org.apache.solr.cloud.DeleteStatusTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteStatusTest_A36D351FE5492D67-001/init-core-data-001
   [junit4]   2> 254370 WARN  (SUITE-DeleteStatusTest-seed#[A36D351FE5492D67]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=795 numCloses=795
   [junit4]   2> 254370 INFO  (SUITE-DeleteStatusTest-seed#[A36D351FE5492D67]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 254373 INFO  (SUITE-DeleteStatusTest-seed#[A36D351FE5492D67]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 254373 INFO  (SUITE-DeleteStatusTest-seed#[A36D351FE5492D67]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 254374 INFO  (SUITE-DeleteStatusTest-seed#[A36D351FE5492D67]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteStatusTest_A36D351FE5492D67-001/tempDir-001
   [junit4]   2> 254374 INFO  (SUITE-DeleteStatusTest-seed#[A36D351FE5492D67]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 254378 INFO  (Thread-364) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 254378 INFO  (Thread-364) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 254402 ERROR (Thread-364) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 254478 INFO  (SUITE-DeleteStatusTest-seed#[A36D351FE5492D67]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:46365
   [junit4]   2> 254490 INFO  (jetty-launcher-315-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 254490 INFO  (jetty-launcher-315-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 254494 INFO  (jetty-launcher-315-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@163b0da{/solr,null,AVAILABLE}
   [junit4]   2> 254496 INFO  (jetty-launcher-315-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1d0ab9{/solr,null,AVAILABLE}
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1853a51{HTTP/1.1,[http/1.1]}{127.0.0.1:43967}
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1a50073{HTTP/1.1,[http/1.1]}{127.0.0.1:45159}
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-2) [    ] o.e.j.s.Server Started @255984ms
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-1) [    ] o.e.j.s.Server Started @255984ms
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45159}
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43967}
   [junit4]   2> 254499 ERROR (jetty-launcher-315-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 254499 ERROR (jetty-launcher-315-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-02T05:01:03.806Z
   [junit4]   2> 254499 INFO  (jetty-launcher-315-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-02T05:01:03.806Z
   [junit4]   2> 254513 INFO  (jetty-launcher-315-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 254515 INFO  (jetty-launcher-315-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 254544 INFO  (jetty-launcher-315-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46365/solr
   [junit4]   2> 254569 INFO  (jetty-launcher-315-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46365/solr
   [junit4]   2> 254699 INFO  (jetty-launcher-315-thread-1) [n:127.0.0.1:45159_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 254700 INFO  (jetty-launcher-315-thread-1) [n:127.0.0.1:45159_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45159_solr
   [junit4]   2> 254701 INFO  (jetty-launcher-315-thread-1) [n:127.0.0.1:45159_solr    ] o.a.s.c.Overseer Overseer (id=98933071130722310-127.0.0.1:45159_solr-n_0000000000) starting
   [junit4]   2> 254707 INFO  (jetty-launcher-315-thread-1) [n:127.0.0.1:45159_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45159_solr
   [junit4]   2> 254710 INFO  (OverseerStateUpdate-98933071130722310-127.0.0.1:45159_solr-n_0000000000) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 254726 INFO  (jetty-launcher-315-thread-2) [n:127.0.0.1:43967_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 254729 INFO  (jetty-launcher-315-thread-2) [n:127.0.0.1:43967_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 254735 INFO  (jetty-launcher-315-thread-2) [n:127.0.0.1:43967_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43967_solr
   [junit4]   2> 254736 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:43967_solr) [n:127.0.0.1:43967_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 254737 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 254999 INFO  (jetty-launcher-315-thread-2) [n:127.0.0.1:43967_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43967.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@196969
   [junit4]   2> 255024 INFO  (jetty-launcher-315-thread-2) [n:127.0.0.1:43967_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43967.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@196969
   [junit4]   2> 255025 INFO  (jetty-launcher-315-thread-2) [n:127.0.0.1:43967_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43967.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@196969
   [junit4]   2> 255028 INFO  (jetty-launcher-315-thread-2) [n:127.0.0.1:43967_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteStatusTest_A36D351FE5492D67-001/tempDir-001/node2/.
   [junit4]   2> 255042 INFO  (jetty-launcher-315-thread-1) [n:127.0.0.1:45159_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45159.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@196969
   [junit4]   2> 255076 INFO  (jetty-launcher-315-thread-1) [n:127.0.0.1:45159_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45159.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@196969
   [junit4]   2> 255076 INFO  (jetty-launcher-315-thread-1) [n:127.0.0.1:45159_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45159.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@196969
   [junit4]   2> 255082 INFO  (jetty-launcher-315-thread-1) [n:127.0.0.1:45159_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteStatusTest_A36D351FE5492D67-001/tempDir-001/node1/.
   [junit4]   2> 255140 INFO  (SUITE-DeleteStatusTest-seed#[A36D351FE5492D67]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 255141 INFO  (SUITE-DeleteStatusTest-seed#[A36D351FE5492D67]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46365/solr ready
   [junit4]   2> 255152 INFO  (TEST-DeleteStatusTest.testDeleteStatusFlush-seed#[A36D351FE5492D67]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteStatusFlush
   [junit4]   2> 255154 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&replicationFactor=1&collection.configName=conf1&name=flush1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 255155 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&replicationFactor=1&collection.configName=conf1&name=flush1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 255157 INFO  (OverseerThreadFactory-1048-thread-1-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.CreateCollectionCmd Create collection flush1
   [junit4]   2> 255157 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=7417f197-02c6-4810-88d7-fff1e60b7abe&replicationFactor=1&collection.configName=conf1&name=flush2&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 255158 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=7417f197-02c6-4810-88d7-fff1e60b7abe&replicationFactor=1&collection.configName=conf1&name=flush2&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 255160 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 255161 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 255161 INFO  (OverseerThreadFactory-1048-thread-2-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.CreateCollectionCmd Create collection flush2
   [junit4]   2> 255266 INFO  (OverseerStateUpdate-98933071130722310-127.0.0.1:45159_solr-n_0000000000) [n:127.0.0.1:45159_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"flush1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"flush1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45159/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 255475 INFO  (qtp15425145-1831) [n:127.0.0.1:45159_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=flush1&version=2&replicaType=NRT&async=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282&coreNodeName=core_node2&name=flush1_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=6
   [junit4]   2> 255475 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=flush1&version=2&replicaType=NRT&async=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282&coreNodeName=core_node2&name=flush1_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 255476 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 255478 INFO  (qtp15425145-1841) [n:127.0.0.1:45159_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282
   [junit4]   2> 255479 INFO  (qtp15425145-1841) [n:127.0.0.1:45159_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 255480 INFO  (OverseerStateUpdate-98933071130722310-127.0.0.1:45159_solr-n_0000000000) [n:127.0.0.1:45159_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"flush2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"flush2_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45159/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 255582 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush1/state.json] for collection [flush1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 255582 INFO  (zkCallback-328-thread-2-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush1/state.json] for collection [flush1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 255690 INFO  (qtp15425145-1843) [n:127.0.0.1:45159_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=flush2&version=2&replicaType=NRT&async=7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832&coreNodeName=core_node2&name=flush2_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=8
   [junit4]   2> 255690 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=flush2&version=2&replicaType=NRT&async=7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832&coreNodeName=core_node2&name=flush2_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 255692 INFO  (qtp15425145-1845) [n:127.0.0.1:45159_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832
   [junit4]   2> 255692 INFO  (qtp15425145-1845) [n:127.0.0.1:45159_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 255796 INFO  (zkCallback-328-thread-2-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush2/state.json] for collection [flush2] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 255796 INFO  (zkCallback-328-thread-3-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush2/state.json] for collection [flush2] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 256162 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 256164 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 256480 INFO  (qtp15425145-1831) [n:127.0.0.1:45159_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282
   [junit4]   2> 256480 INFO  (qtp15425145-1831) [n:127.0.0.1:45159_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 256497 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 256516 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.s.IndexSchema [flush1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 256522 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 256522 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'flush1_shard1_replica_n1' using configuration from collection flush1, trusted=true
   [junit4]   2> 256523 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45159.solr.core.flush1.shard1.replica_n1' (registry 'solr.core.flush1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@196969
   [junit4]   2> 256523 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 256523 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.SolrCore [[flush1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteStatusTest_A36D351FE5492D67-001/tempDir-001/node1/flush1_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteStatusTest_A36D351FE5492D67-001/tempDir-001/node1/./flush1_shard1_replica_n1/data/]
   [junit4]   2> 256605 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 256605 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 256610 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 256611 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 256612 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1ab8575[flush1_shard1_replica_n1] main]
   [junit4]   2> 256613 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 256614 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 256614 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 256616 INFO  (searcherExecutor-1053-thread-1-processing-x:flush1_shard1_replica_n1 r:core_node2 dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE n:127.0.0.1:45159_solr s:shard1 c:flush1) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.SolrCore [flush1_shard1_replica_n1] Registered new searcher Searcher@1ab8575[flush1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 256616 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582929140434075648
   [junit4]   2> 256620 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 256621 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 256621 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45159/solr/flush1_shard1_replica_n1/
   [junit4]   2> 256621 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 256621 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:45159/solr/flush1_shard1_replica_n1/ has no replicas
   [junit4]   2> 256621 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 256623 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45159/solr/flush1_shard1_replica_n1/ shard1
   [junit4]   2> 256694 INFO  (qtp15425145-1841) [n:127.0.0.1:45159_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832
   [junit4]   2> 256694 INFO  (qtp15425145-1841) [n:127.0.0.1:45159_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 256713 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 256734 INFO  (zkCallback-328-thread-3-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush1/state.json] for collection [flush1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 256734 INFO  (zkCallback-328-thread-2-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush1/state.json] for collection [flush1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 256747 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.s.IndexSchema [flush2_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 256767 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 256767 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'flush2_shard1_replica_n1' using configuration from collection flush2, trusted=true
   [junit4]   2> 256767 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45159.solr.core.flush2.shard1.replica_n1' (registry 'solr.core.flush2.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@196969
   [junit4]   2> 256768 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 256768 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.SolrCore [[flush2_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteStatusTest_A36D351FE5492D67-001/tempDir-001/node1/flush2_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteStatusTest_A36D351FE5492D67-001/tempDir-001/node1/./flush2_shard1_replica_n1/data/]
   [junit4]   2> 256783 INFO  (parallelCoreAdminExecutor-1050-thread-1-processing-n:127.0.0.1:45159_solr dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282 CREATE) [n:127.0.0.1:45159_solr c:flush1 s:shard1 r:core_node2 x:flush1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 256872 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 256872 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 256873 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 256874 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 256875 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@16ca76[flush2_shard1_replica_n1] main]
   [junit4]   2> 256876 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 256877 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 256878 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 256878 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582929140708802560
   [junit4]   2> 256881 INFO  (searcherExecutor-1058-thread-1-processing-x:flush2_shard1_replica_n1 r:core_node2 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE n:127.0.0.1:45159_solr s:shard1 c:flush2) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.SolrCore [flush2_shard1_replica_n1] Registered new searcher Searcher@16ca76[flush2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 256883 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 256883 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 256883 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45159/solr/flush2_shard1_replica_n1/
   [junit4]   2> 256883 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 256883 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:45159/solr/flush2_shard1_replica_n1/ has no replicas
   [junit4]   2> 256883 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 256885 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45159/solr/flush2_shard1_replica_n1/ shard1
   [junit4]   2> 256886 INFO  (zkCallback-328-thread-3-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush1/state.json] for collection [flush1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 256886 INFO  (zkCallback-328-thread-2-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush1/state.json] for collection [flush1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 256994 INFO  (zkCallback-328-thread-2-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush2/state.json] for collection [flush2] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 256994 INFO  (zkCallback-328-thread-3-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush2/state.json] for collection [flush2] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 257037 INFO  (parallelCoreAdminExecutor-1050-thread-2-processing-n:127.0.0.1:45159_solr 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832 CREATE) [n:127.0.0.1:45159_solr c:flush2 s:shard1 r:core_node2 x:flush2_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 257141 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush2/state.json] for collection [flush2] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 257141 INFO  (zkCallback-328-thread-3-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush2/state.json] for collection [flush2] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 257165 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 257166 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 257481 INFO  (qtp15425145-1843) [n:127.0.0.1:45159_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282
   [junit4]   2> 257482 INFO  (qtp15425145-1843) [n:127.0.0.1:45159_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2324212741499282&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 257490 INFO  (OverseerThreadFactory-1048-thread-1-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 257695 INFO  (qtp15425145-1845) [n:127.0.0.1:45159_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832
   [junit4]   2> 257696 INFO  (qtp15425145-1845) [n:127.0.0.1:45159_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7417f197-02c6-4810-88d7-fff1e60b7abe324212956970832&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 257701 INFO  (OverseerThreadFactory-1048-thread-2-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000001 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 258167 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 258173 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=6
   [junit4]   2> 258174 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7417f197-02c6-4810-88d7-fff1e60b7abe&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 258176 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7417f197-02c6-4810-88d7-fff1e60b7abe&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 258177 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params flush=true&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 258179 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={flush=true&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 258180 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 258181 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=dfe40ece-aac5-40a1-8d7f-2ea3298e54b2&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 258182 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7417f197-02c6-4810-88d7-fff1e60b7abe&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 258183 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7417f197-02c6-4810-88d7-fff1e60b7abe&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 258183 INFO  (TEST-DeleteStatusTest.testDeleteStatusFlush-seed#[A36D351FE5492D67]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDeleteStatusFlush
   [junit4]   2> 258202 INFO  (TEST-DeleteStatusTest.testAsyncIdsMayBeDeleted-seed#[A36D351FE5492D67]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAsyncIdsMayBeDeleted
   [junit4]   2> 258203 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=2e224be6-8e24-4b11-85e0-3bd207545fa4&replicationFactor=1&collection.configName=conf1&name=deletestatus&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 258204 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=2e224be6-8e24-4b11-85e0-3bd207545fa4&replicationFactor=1&collection.configName=conf1&name=deletestatus&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 258206 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 258207 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 258207 INFO  (OverseerThreadFactory-1048-thread-3-processing-n:127.0.0.1:45159_solr) [n:127.0.0.1:45159_solr    ] o.a.s.c.CreateCollectionCmd Create collection deletestatus
   [junit4]   2> 258208 INFO  (OverseerCollectionConfigSetProcessor-98933071130722310-127.0.0.1:45159_solr-n_0000000000) [n:127.0.0.1:45159_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 258208 INFO  (OverseerCollectionConfigSetProcessor-98933071130722310-127.0.0.1:45159_solr-n_0000000000) [n:127.0.0.1:45159_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000001 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 258424 INFO  (OverseerStateUpdate-98933071130722310-127.0.0.1:45159_solr-n_0000000000) [n:127.0.0.1:45159_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deletestatus",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deletestatus_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:43967/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 258628 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=deletestatus&version=2&replicaType=NRT&async=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&coreNodeName=core_node2&name=deletestatus_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=0
   [junit4]   2> 258628 INFO  (parallelCoreAdminExecutor-1049-thread-1-processing-n:127.0.0.1:43967_solr 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393 CREATE) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=deletestatus&version=2&replicaType=NRT&async=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&coreNodeName=core_node2&name=deletestatus_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 258629 INFO  (parallelCoreAdminExecutor-1049-thread-1-processing-n:127.0.0.1:43967_solr 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393 CREATE) [n:127.0.0.1:43967_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 258630 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 258630 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 259209 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 259210 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 259633 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 259633 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 260212 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 260215 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 260635 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 260635 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 261216 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 261217 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 261636 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 261636 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 262219 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 262221 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 262638 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 262638 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 263222 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 263223 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 263640 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 263640 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 264224 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 264225 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 264641 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 264641 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 265226 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 265227 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 265643 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 265643 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 266229 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 266229 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 266644 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 266644 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 267231 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 267232 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 267646 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 267646 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 268234 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 268236 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 268647 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 268647 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 269237 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 269238 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 269649 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 269649 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 270239 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 270240 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 270650 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 270650 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 271242 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 271242 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 271652 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 271652 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 272243 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 272244 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 272653 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 272653 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 273245 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 273246 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 273656 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 273656 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 274247 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 274248 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 274658 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 274658 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 275249 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 275250 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 275660 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 275660 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 276252 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 276254 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 276662 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 276662 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 277255 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 277256 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 277663 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 277664 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 278257 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 278258 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 278665 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 278665 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 279260 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 279261 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 279666 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 279666 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 280263 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 280264 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 280668 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 280668 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 281266 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 281268 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 281670 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 281670 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 282269 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 282270 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 282672 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 282672 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 283271 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 283272 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 283674 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 283674 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 284274 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 284275 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 284681 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 284681 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 285277 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 285279 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 285683 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 285683 INFO  (qtp1884114-1840) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 286281 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 286283 INFO  (qtp1884114-1832) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 286685 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 286685 INFO  (qtp1884114-1842) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 287285 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 287287 INFO  (qtp1884114-1830) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 287687 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393
   [junit4]   2> 287687 INFO  (qtp1884114-1844) [n:127.0.0.1:43967_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2e224be6-8e24-4b11-85e0-3bd207545fa4324215901822393&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 288288 INFO  (TEST-DeleteStatusTest.testAsyncIdsMayBeDeleted-seed#[A36D351FE5492D67]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testAsyncIdsMayBeDeleted
   [junit4] IGNOR/A 30.1s J2 | DeleteStatusTest.testAsyncIdsMayBeDeleted
   [junit4]    > Assumption #1: Timed out creating collection - skipping test
   [junit4]   2> 288315 INFO  (TEST-DeleteStatusTest.testDeletingNonExistentRequests-seed#[A36D351FE5492D67]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDeletingNonExistentRequests
  

[...truncated too long message...]

junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2>         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2> Nov 02, 2017 5:46:51 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=22781, name=jetty-launcher-1847-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2> 3002649 ERROR (jetty-launcher-1847-thread-1-EventThread) [n:127.0.0.1:32851_solr    ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2> 	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2> 	at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2> 	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2> Nov 02, 2017 5:46:51 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@128387), locale=ms-MY, timezone=America/Atikokan
   [junit4]   2> NOTE: Linux 4.10.0-37-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=74997088,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestBulkSchemaConcurrent, TestJsonRequest, BlockCacheTest, ComputePlanActionTest, TestCollationField, AutoAddReplicasIntegrationTest, TestFileDictionaryLookup, SolrCmdDistributorTest, NumericFieldsTest, PKIAuthenticationIntegrationTest, HdfsDirectoryTest, PolyFieldTest, TestConfigSetsAPIExclusivity, TestSchemaSimilarityResource, TestFastLRUCache, RegexBoostProcessorTest, SolrIndexConfigTest, TestJmxIntegration, TestWriterPerf, ExplicitHLLTest, TestHttpShardHandlerFactory, SuggestComponentTest, TestGraphMLResponseWriter, HdfsRestartWhileUpdatingTest, DistanceUnitsTest, TestConfigSetImmutable, TestSolrQueryParser, TestPerFieldSimilarityWithDefaultOverride, ConvertedLegacyTest, TestRestoreCore, TestSolrQueryResponse, CdcrRequestHandlerTest, TestDeleteCollectionOnDownNodes, TestAuthenticationFramework, CheckHdfsIndexTest, BinaryUpdateRequestHandlerTest, HdfsNNFailoverTest, TestNamedUpdateProcessors, DeleteShardTest, BadIndexSchemaTest, SolrIndexSplitterTest, TestCursorMarkWithoutUniqueKey, TestObjectReleaseTracker, SolrJmxReporterCloudTest, TestLuceneMatchVersion, MultiThreadedOCPTest, AddReplicaTest, MBeansHandlerTest, TestLegacyNumericRangeQueryBuilder, TestSSLRandomization, ZkStateWriterTest, TestCollapseQParserPlugin, ChaosMonkeySafeLeaderTest, TestDocumentBuilder, ClassificationUpdateProcessorIntegrationTest, PreAnalyzedFieldTest, TestPayloadCheckQParserPlugin, SpellCheckCollatorWithCollapseTest, TestExclusionRuleCollectionAccess, CollectionTooManyReplicasTest, TestMultiWordSynonyms, CdcrBootstrapTest, TestSimpleTrackingShardHandler, DistributedFacetPivotSmallAdvancedTest, SearchRateTriggerTest, TestRawResponseWriter, TestLegacyNumericUtils, TestFastWriter, TermVectorComponentDistributedTest, TestUniqueKeyFieldResource, TestStressLucene, TestFieldCache, TestDocSet, TestPseudoReturnFields, TestStressRecovery, TestCollationFieldDocValues, JavabinLoaderTest, TestManagedSchemaAPI, TestSimpleTextCodec, TestRandomCollapseQParserPlugin, SolrMetricsIntegrationTest, DistributedIntervalFacetingTest, TestStreamBody, CachingDirectoryFactoryTest, TestCustomDocTransformer, ShowFileRequestHandlerTest, TestCoreAdminApis, UpdateLogTest, TestAnalyzedSuggestions, TestNestedDocsSort, CloudExitableDirectoryReaderTest, TestUseDocValuesAsStored2, LeaderFailoverAfterPartitionTest, PreAnalyzedUpdateProcessorTest, RequestHandlersTest, SolrCoreMetricManagerTest, TestRecoveryHdfs, TestSurroundQueryParser, TestSchemaManager, TestFieldTypeResource, InfoHandlerTest, HttpTriggerListenerTest, HighlighterConfigTest, QueryResultKeyTest, TestSimpleQParserPlugin, SearchHandlerTest, MoreLikeThisHandlerTest, TestCorePropertiesReload, TestSolrCoreParser, TestSubQueryTransformerCrossCore, OpenExchangeRatesOrgProviderTest, SpellingQueryConverterTest, DebugComponentTest, TriLevelCompositeIdRoutingTest, TestStressInPlaceUpdates, TestReplicaProperties, PeerSyncReplicationTest, TestCopyFieldCollectionResource, TestCustomSort, BJQParserTest, DocValuesMultiTest, BasicDistributedZkTest, SSLMigrationTest, SaslZkACLProviderTest, ShardSplitTest, TestSolrCloudWithSecureImpersonation]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=A36D351FE5492D67 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ms-MY -Dtests.timezone=America/Atikokan -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   [junit4]    >    1) Thread[id=22781, name=jetty-launcher-1847-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]    >         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]    >         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]    >         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]    >         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([A36D351FE5492D67]:0)
   [junit4] Completed [567/747 (3!)] on J1 in 54.20s, 12 tests, 1 error <<< FAILURES!

[...truncated 43691 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20800 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20800/
Java: 64bit/jdk1.8.0_144 -XX:-UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.lucene.spatial3d.geom.RandomGeoShapeRelationshipTest.testRandomContains

Error Message:
geoAreaShape: GeoExactCircle: {planetmodel=PlanetModel.WGS84, center=[lat=-0.00871130560892533, lon=2.3029626482941588([X=-0.6692047265792528, Y=0.7445316825911176, Z=-0.008720939756154669])], radius=3.038428918538668(174.0891533827647), accuracy=2.111101444186927E-4} shape: GeoRectangle: {planetmodel=PlanetModel.WGS84, toplat=0.18851664435052304(10.801208089253723), bottomlat=-1.4896034997154073(-85.34799368160976), leftlon=-1.4970589804391838(-85.7751612613233), rightlon=1.346321571653886(77.13854392318753)} expected:<0> but was:<2>

Stack Trace:
java.lang.AssertionError: geoAreaShape: GeoExactCircle: {planetmodel=PlanetModel.WGS84, center=[lat=-0.00871130560892533, lon=2.3029626482941588([X=-0.6692047265792528, Y=0.7445316825911176, Z=-0.008720939756154669])], radius=3.038428918538668(174.0891533827647), accuracy=2.111101444186927E-4}
shape: GeoRectangle: {planetmodel=PlanetModel.WGS84, toplat=0.18851664435052304(10.801208089253723), bottomlat=-1.4896034997154073(-85.34799368160976), leftlon=-1.4970589804391838(-85.7751612613233), rightlon=1.346321571653886(77.13854392318753)} expected:<0> but was:<2>
	at __randomizedtesting.SeedInfo.seed([87612C9805977C6F:B087E212A0C8DB25]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.lucene.spatial3d.geom.RandomGeoShapeRelationshipTest.testRandomContains(RandomGeoShapeRelationshipTest.java:225)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestPrepRecovery.testLeaderUnloaded

Error Message:
Error from server at https://127.0.0.1:32807/solr: Timed out waiting to see all replicas: [testLeaderUnloaded_shard1_replica_n7] in cluster state.

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:32807/solr: Timed out waiting to see all replicas: [testLeaderUnloaded_shard1_replica_n7] in cluster state.
	at __randomizedtesting.SeedInfo.seed([E9B5B9085E370499:BA12AAFEA31BEA9B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.cloud.TestPrepRecovery.testLeaderUnloaded(TestPrepRecovery.java:79)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 9699 lines...]
   [junit4] Suite: org.apache.lucene.spatial3d.geom.RandomGeoShapeRelationshipTest
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=RandomGeoShapeRelationshipTest -Dtests.method=testRandomContains -Dtests.seed=87612C9805977C6F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fi-FI -Dtests.timezone=Africa/Mbabane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 17.1s J2 | RandomGeoShapeRelationshipTest.testRandomContains <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: geoAreaShape: GeoExactCircle: {planetmodel=PlanetModel.WGS84, center=[lat=-0.00871130560892533, lon=2.3029626482941588([X=-0.6692047265792528, Y=0.7445316825911176, Z=-0.008720939756154669])], radius=3.038428918538668(174.0891533827647), accuracy=2.111101444186927E-4}
   [junit4]    > shape: GeoRectangle: {planetmodel=PlanetModel.WGS84, toplat=0.18851664435052304(10.801208089253723), bottomlat=-1.4896034997154073(-85.34799368160976), leftlon=-1.4970589804391838(-85.7751612613233), rightlon=1.346321571653886(77.13854392318753)} expected:<0> but was:<2>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([87612C9805977C6F:B087E212A0C8DB25]:0)
   [junit4]    > 	at org.apache.lucene.spatial3d.geom.RandomGeoShapeRelationshipTest.testRandomContains(RandomGeoShapeRelationshipTest.java:225)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=2026, maxMBSortInHeap=7.049530796534057, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@131889a6), locale=fi-FI, timezone=Africa/Mbabane
   [junit4]   2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=472120112,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [GeoPointTest, RandomBinaryCodecTest, RandomGeoShapeRelationshipTest]
   [junit4] Completed [12/15 (1!)] on J2 in 20.06s, 26 tests, 1 failure <<< FAILURES!

[...truncated 2405 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestPrepRecovery
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/init-core-data-001
   [junit4]   2> 472608 WARN  (SUITE-TestPrepRecovery-seed#[E9B5B9085E370499]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=44 numCloses=44
   [junit4]   2> 472608 INFO  (SUITE-TestPrepRecovery-seed#[E9B5B9085E370499]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 472609 INFO  (SUITE-TestPrepRecovery-seed#[E9B5B9085E370499]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 472609 INFO  (SUITE-TestPrepRecovery-seed#[E9B5B9085E370499]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 472610 INFO  (SUITE-TestPrepRecovery-seed#[E9B5B9085E370499]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001
   [junit4]   2> 472611 INFO  (SUITE-TestPrepRecovery-seed#[E9B5B9085E370499]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 472611 INFO  (Thread-882) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 472612 INFO  (Thread-882) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 472613 ERROR (Thread-882) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 472711 INFO  (SUITE-TestPrepRecovery-seed#[E9B5B9085E370499]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:44103
   [junit4]   2> 472717 INFO  (jetty-launcher-490-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 472717 INFO  (jetty-launcher-490-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 472724 INFO  (jetty-launcher-490-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@479c64f8{/solr,null,AVAILABLE}
   [junit4]   2> 472725 INFO  (jetty-launcher-490-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@56232e19{/solr,null,AVAILABLE}
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7630d1d5{SSL,[ssl, http/1.1]}{127.0.0.1:32807}
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3056fc0d{SSL,[ssl, http/1.1]}{127.0.0.1:37453}
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-2) [    ] o.e.j.s.Server Started @474513ms
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=32807}
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-1) [    ] o.e.j.s.Server Started @474513ms
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37453}
   [junit4]   2> 472730 ERROR (jetty-launcher-490-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 472730 ERROR (jetty-launcher-490-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-02T02:03:29.777Z
   [junit4]   2> 472730 INFO  (jetty-launcher-490-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-02T02:03:29.777Z
   [junit4]   2> 472734 INFO  (jetty-launcher-490-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 472734 INFO  (jetty-launcher-490-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 472737 INFO  (jetty-launcher-490-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 472737 INFO  (jetty-launcher-490-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 472737 INFO  (jetty-launcher-490-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 472737 INFO  (jetty-launcher-490-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 472738 INFO  (jetty-launcher-490-thread-2) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7bd8f784, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 472738 INFO  (jetty-launcher-490-thread-1) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7bd8f784, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 472741 INFO  (jetty-launcher-490-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44103/solr
   [junit4]   2> 472745 INFO  (jetty-launcher-490-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44103/solr
   [junit4]   2> 472793 INFO  (jetty-launcher-490-thread-1) [n:127.0.0.1:37453_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 472793 INFO  (jetty-launcher-490-thread-1) [n:127.0.0.1:37453_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37453_solr
   [junit4]   2> 472793 INFO  (jetty-launcher-490-thread-1) [n:127.0.0.1:37453_solr    ] o.a.s.c.Overseer Overseer (id=98932372908212230-127.0.0.1:37453_solr-n_0000000000) starting
   [junit4]   2> 472796 INFO  (jetty-launcher-490-thread-2) [n:127.0.0.1:32807_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 472803 INFO  (jetty-launcher-490-thread-2) [n:127.0.0.1:32807_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32807_solr
   [junit4]   2> 472806 INFO  (zkCallback-502-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 472808 INFO  (jetty-launcher-490-thread-1) [n:127.0.0.1:37453_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37453_solr
   [junit4]   2> 472818 INFO  (zkCallback-498-thread-1-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 472819 INFO  (zkCallback-498-thread-1-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 472823 INFO  (zkCallback-502-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 472871 INFO  (jetty-launcher-490-thread-2) [n:127.0.0.1:32807_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bd8f784
   [junit4]   2> 472877 INFO  (jetty-launcher-490-thread-1) [n:127.0.0.1:37453_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bd8f784
   [junit4]   2> 472878 INFO  (jetty-launcher-490-thread-2) [n:127.0.0.1:32807_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bd8f784
   [junit4]   2> 472878 INFO  (jetty-launcher-490-thread-2) [n:127.0.0.1:32807_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bd8f784
   [junit4]   2> 472879 INFO  (jetty-launcher-490-thread-2) [n:127.0.0.1:32807_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/.
   [junit4]   2> 472883 INFO  (jetty-launcher-490-thread-1) [n:127.0.0.1:37453_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bd8f784
   [junit4]   2> 472883 INFO  (jetty-launcher-490-thread-1) [n:127.0.0.1:37453_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bd8f784
   [junit4]   2> 472884 INFO  (jetty-launcher-490-thread-1) [n:127.0.0.1:37453_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/.
   [junit4]   2> 472915 INFO  (SUITE-TestPrepRecovery-seed#[E9B5B9085E370499]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 472915 INFO  (SUITE-TestPrepRecovery-seed#[E9B5B9085E370499]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44103/solr ready
   [junit4]   2> 472933 INFO  (TEST-TestPrepRecovery.testLeaderNotResponding-seed#[E9B5B9085E370499]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLeaderNotResponding
   [junit4]   2> 472958 INFO  (qtp538985609-3321) [n:127.0.0.1:32807_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&name=testLeaderNotResponding&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 472960 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.CreateCollectionCmd Create collection testLeaderNotResponding
   [junit4]   2> 472960 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.CreateCollectionCmd Only _default config set found, using it.
   [junit4]   2> 472961 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/testLeaderNotResponding/protwords.txt
   [junit4]   2> 472962 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/testLeaderNotResponding/managed-schema
   [junit4]   2> 472963 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/testLeaderNotResponding/solrconfig.xml
   [junit4]   2> 472964 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/testLeaderNotResponding/synonyms.txt
   [junit4]   2> 472965 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/testLeaderNotResponding/stopwords.txt
   [junit4]   2> 472968 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/testLeaderNotResponding/lang/contractions_it.txt
   [junit4]   2> 472970 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/testLeaderNotResponding/lang/stemdict_nl.txt
   [junit4]   2> 472971 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/testLeaderNotResponding/lang/stopwords_hy.txt
   [junit4]   2> 472973 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/testLeaderNotResponding/lang/stopwords_no.txt
   [junit4]   2> 472974 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/testLeaderNotResponding/lang/contractions_ca.txt
   [junit4]   2> 472974 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/testLeaderNotResponding/lang/stopwords_id.txt
   [junit4]   2> 472975 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/testLeaderNotResponding/lang/stopwords_ga.txt
   [junit4]   2> 472975 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/testLeaderNotResponding/lang/stopwords_hi.txt
   [junit4]   2> 472976 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/testLeaderNotResponding/lang/stopwords_da.txt
   [junit4]   2> 472976 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/testLeaderNotResponding/lang/stopwords_ja.txt
   [junit4]   2> 472977 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/testLeaderNotResponding/lang/stopwords_pt.txt
   [junit4]   2> 472977 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/testLeaderNotResponding/lang/stopwords_hu.txt
   [junit4]   2> 472977 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/testLeaderNotResponding/lang/stopwords_el.txt
   [junit4]   2> 472978 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/testLeaderNotResponding/lang/stopwords_ru.txt
   [junit4]   2> 472978 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/testLeaderNotResponding/lang/stopwords_tr.txt
   [junit4]   2> 472979 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/testLeaderNotResponding/lang/stopwords_ar.txt
   [junit4]   2> 472979 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/testLeaderNotResponding/lang/userdict_ja.txt
   [junit4]   2> 472980 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/testLeaderNotResponding/lang/stopwords_eu.txt
   [junit4]   2> 472981 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/testLeaderNotResponding/lang/stopwords_it.txt
   [junit4]   2> 472981 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/testLeaderNotResponding/lang/stopwords_cz.txt
   [junit4]   2> 472984 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/testLeaderNotResponding/lang/stoptags_ja.txt
   [junit4]   2> 472985 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/testLeaderNotResponding/lang/contractions_fr.txt
   [junit4]   2> 472986 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/testLeaderNotResponding/lang/stopwords_de.txt
   [junit4]   2> 472988 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/testLeaderNotResponding/lang/stopwords_fa.txt
   [junit4]   2> 472988 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/testLeaderNotResponding/lang/contractions_ga.txt
   [junit4]   2> 472990 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/testLeaderNotResponding/lang/stopwords_ca.txt
   [junit4]   2> 472990 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/testLeaderNotResponding/lang/stopwords_nl.txt
   [junit4]   2> 472990 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/testLeaderNotResponding/lang/stopwords_bg.txt
   [junit4]   2> 472991 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/testLeaderNotResponding/lang/stopwords_lv.txt
   [junit4]   2> 472991 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/testLeaderNotResponding/lang/stopwords_en.txt
   [junit4]   2> 472992 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/testLeaderNotResponding/lang/stopwords_es.txt
   [junit4]   2> 472992 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/testLeaderNotResponding/lang/stopwords_th.txt
   [junit4]   2> 472993 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/testLeaderNotResponding/lang/stopwords_ro.txt
   [junit4]   2> 472993 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/testLeaderNotResponding/lang/stopwords_fr.txt
   [junit4]   2> 472994 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/testLeaderNotResponding/lang/stopwords_sv.txt
   [junit4]   2> 472994 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/testLeaderNotResponding/lang/stopwords_fi.txt
   [junit4]   2> 472995 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/testLeaderNotResponding/lang/hyphenations_ga.txt
   [junit4]   2> 472995 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/testLeaderNotResponding/lang/stopwords_gl.txt
   [junit4]   2> 472995 INFO  (OverseerThreadFactory-1259-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/testLeaderNotResponding/params.json
   [junit4]   2> 473099 INFO  (OverseerStateUpdate-98932372908212230-127.0.0.1:37453_solr-n_0000000000) [n:127.0.0.1:37453_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testLeaderNotResponding",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testLeaderNotResponding_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:32807/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 473305 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=testLeaderNotResponding&newCollection=true&name=testLeaderNotResponding_shard1_replica_n1&action=CREATE&numShards=1&collection=testLeaderNotResponding&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 473305 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 473411 INFO  (zkCallback-498-thread-1-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 473411 INFO  (zkCallback-498-thread-2-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 474318 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 474319 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 474320 WARN  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../contrib/extraction/lib
   [junit4]   2> 474320 WARN  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../dist
   [junit4]   2> 474320 WARN  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../contrib/clustering/lib
   [junit4]   2> 474320 WARN  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../dist
   [junit4]   2> 474320 WARN  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../contrib/langid/lib
   [junit4]   2> 474320 WARN  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../dist
   [junit4]   2> 474321 WARN  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../contrib/velocity/lib
   [junit4]   2> 474321 WARN  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1/../../../../dist
   [junit4]   2> 474325 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 474341 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.s.IndexSchema [testLeaderNotResponding_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 474560 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 474597 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testLeaderNotResponding_shard1_replica_n1' using configuration from collection testLeaderNotResponding, trusted=true
   [junit4]   2> 474597 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.testLeaderNotResponding.shard1.replica_n1' (registry 'solr.core.testLeaderNotResponding.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bd8f784
   [junit4]   2> 474597 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 474597 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrCore [[testLeaderNotResponding_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/testLeaderNotResponding_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node2/./testLeaderNotResponding_shard1_replica_n1/data/]
   [junit4]   2> 474841 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 474986 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 474986 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 474987 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 474987 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 474988 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@54b30b28[testLeaderNotResponding_shard1_replica_n1] main]
   [junit4]   2> 474990 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/testLeaderNotResponding
   [junit4]   2> 474990 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/testLeaderNotResponding
   [junit4]   2> 474990 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/testLeaderNotResponding/managed-schema
   [junit4]   2> 474991 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 474991 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 474996 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 475004 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 475004 INFO  (searcherExecutor-1264-thread-1-processing-n:127.0.0.1:32807_solr x:testLeaderNotResponding_shard1_replica_n1 s:shard1 c:testLeaderNotResponding r:core_node2) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@54b30b28[testLeaderNotResponding_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 475004 INFO  (searcherExecutor-1264-thread-1-processing-n:127.0.0.1:32807_solr x:testLeaderNotResponding_shard1_replica_n1 s:shard1 c:testLeaderNotResponding r:core_node2) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 475004 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582917969039589376
   [junit4]   2> 475005 INFO  (searcherExecutor-1264-thread-1-processing-n:127.0.0.1:32807_solr x:testLeaderNotResponding_shard1_replica_n1 s:shard1 c:testLeaderNotResponding r:core_node2) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 475005 INFO  (searcherExecutor-1264-thread-1-processing-n:127.0.0.1:32807_solr x:testLeaderNotResponding_shard1_replica_n1 s:shard1 c:testLeaderNotResponding r:core_node2) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SolrCore [testLeaderNotResponding_shard1_replica_n1] Registered new searcher Searcher@54b30b28[testLeaderNotResponding_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 475007 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 475007 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 475007 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:32807/solr/testLeaderNotResponding_shard1_replica_n1/
   [junit4]   2> 475007 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 475007 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:32807/solr/testLeaderNotResponding_shard1_replica_n1/ has no replicas
   [junit4]   2> 475007 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 475008 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:32807/solr/testLeaderNotResponding_shard1_replica_n1/ shard1
   [junit4]   2> 475109 INFO  (zkCallback-498-thread-2-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 475109 INFO  (zkCallback-498-thread-1-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 475158 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 475159 INFO  (qtp538985609-3320) [n:127.0.0.1:32807_solr c:testLeaderNotResponding s:shard1 r:core_node2 x:testLeaderNotResponding_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=testLeaderNotResponding&newCollection=true&name=testLeaderNotResponding_shard1_replica_n1&action=CREATE&numShards=1&collection=testLeaderNotResponding&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1854
   [junit4]   2> 475161 INFO  (qtp538985609-3321) [n:127.0.0.1:32807_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 475260 INFO  (zkCallback-498-thread-1-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 475260 INFO  (zkCallback-498-thread-2-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 476161 INFO  (qtp538985609-3321) [n:127.0.0.1:32807_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&name=testLeaderNotResponding&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3203
   [junit4]   2> 476166 INFO  (qtp538985609-3314) [n:127.0.0.1:32807_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params action=ADDREPLICA&collection=testLeaderNotResponding&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 476167 INFO  (OverseerCollectionConfigSetProcessor-98932372908212230-127.0.0.1:37453_solr-n_0000000000) [n:127.0.0.1:37453_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 476168 INFO  (OverseerThreadFactory-1259-thread-2-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:37453_solr for creating new replica
   [junit4]   2> 476168 INFO  (OverseerStateUpdate-98932372908212230-127.0.0.1:37453_solr-n_0000000000) [n:127.0.0.1:37453_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"testLeaderNotResponding",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testLeaderNotResponding_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:37453/solr",
   [junit4]   2>   "node_name":"127.0.0.1:37453_solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 476269 INFO  (zkCallback-498-thread-1-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 476269 INFO  (zkCallback-498-thread-2-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 476388 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=testLeaderNotResponding&name=testLeaderNotResponding_shard1_replica_n3&action=CREATE&collection=testLeaderNotResponding&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 476388 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 476397 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 476397 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 476398 WARN  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../contrib/extraction/lib
   [junit4]   2> 476399 WARN  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../dist
   [junit4]   2> 476399 WARN  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../contrib/clustering/lib
   [junit4]   2> 476399 WARN  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../dist
   [junit4]   2> 476399 WARN  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../contrib/langid/lib
   [junit4]   2> 476399 WARN  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../dist
   [junit4]   2> 476400 WARN  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../contrib/velocity/lib
   [junit4]   2> 476400 WARN  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3/../../../../dist
   [junit4]   2> 476405 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 476420 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.s.IndexSchema [testLeaderNotResponding_shard1_replica_n3] Schema name=default-config
   [junit4]   2> 476490 INFO  (zkCallback-502-thread-1-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 476490 INFO  (zkCallback-498-thread-2-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 476490 INFO  (zkCallback-502-thread-2-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 476490 INFO  (zkCallback-498-thread-1-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 476551 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 476566 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'testLeaderNotResponding_shard1_replica_n3' using configuration from collection testLeaderNotResponding, trusted=true
   [junit4]   2> 476567 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.testLeaderNotResponding.shard1.replica_n3' (registry 'solr.core.testLeaderNotResponding.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bd8f784
   [junit4]   2> 476567 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 476567 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrCore [[testLeaderNotResponding_shard1_replica_n3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/testLeaderNotResponding_shard1_replica_n3], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001/tempDir-001/node1/./testLeaderNotResponding_shard1_replica_n3/data/]
   [junit4]   2> 476588 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 476637 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 476637 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 476639 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 476639 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 476640 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@73da6624[testLeaderNotResponding_shard1_replica_n3] main]
   [junit4]   2> 476641 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/testLeaderNotResponding
   [junit4]   2> 476641 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/testLeaderNotResponding
   [junit4]   2> 476641 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/testLeaderNotResponding/managed-schema
   [junit4]   2> 476641 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 476642 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 476642 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 476643 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 476643 INFO  (searcherExecutor-1269-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@73da6624[testLeaderNotResponding_shard1_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 476643 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582917970758205440
   [junit4]   2> 476643 INFO  (searcherExecutor-1269-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 476643 INFO  (searcherExecutor-1269-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 476644 INFO  (searcherExecutor-1269-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.SolrCore [testLeaderNotResponding_shard1_replica_n3] Registered new searcher Searcher@73da6624[testLeaderNotResponding_shard1_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 476645 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.ZkController Core needs to recover:testLeaderNotResponding_shard1_replica_n3
   [junit4]   2> 476646 INFO  (updateExecutor-499-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 476646 INFO  (qtp1358623663-3328) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=testLeaderNotResponding&name=testLeaderNotResponding_shard1_replica_n3&action=CREATE&collection=testLeaderNotResponding&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=258
   [junit4]   2> 476646 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 476646 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 476647 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[testLeaderNotResponding_shard1_replica_n3]
   [junit4]   2> 476647 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 476647 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy Publishing state of core [testLeaderNotResponding_shard1_replica_n3] as recovering, leader is [https://127.0.0.1:32807/solr/testLeaderNotResponding_shard1_replica_n1/] and I am [https://127.0.0.1:37453/solr/testLeaderNotResponding_shard1_replica_n3/]
   [junit4]   2> 476647 INFO  (qtp538985609-3314) [n:127.0.0.1:32807_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=ADDREPLICA&collection=testLeaderNotResponding&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=481
   [junit4]   2> 476649 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:32807/solr]; [WaitForState: action=PREPRECOVERY&core=testLeaderNotResponding_shard1_replica_n1&nodeName=127.0.0.1:37453_solr&coreNodeName=core_node4&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 476657 INFO  (qtp538985609-3321) [n:127.0.0.1:32807_solr    ] o.a.s.u.TestInjection inject pause forever for prep recovery op
   [junit4]   2> 476749 INFO  (zkCallback-502-thread-3-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 476749 INFO  (zkCallback-498-thread-1-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 476749 INFO  (zkCallback-502-thread-2-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 476749 INFO  (zkCallback-498-thread-2-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 476749 INFO  (zkCallback-509-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 478168 INFO  (OverseerCollectionConfigSetProcessor-98932372908212230-127.0.0.1:37453_solr-n_0000000000) [n:127.0.0.1:37453_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 494672 ERROR (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy Error while trying to recover. core=testLeaderNotResponding_shard1_replica_n3:java.util.concurrent.ExecutionException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:32807/solr
   [junit4]   2> 	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
   [junit4]   2> 	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
   [junit4]   2> 	at org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:831)
   [junit4]   2> 	at org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:568)
   [junit4]   2> 	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:308)
   [junit4]   2> 	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:292)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:32807/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.lambda$httpUriRequest$0(HttpSolrClient.java:299)
   [junit4]   2> 	... 5 more
   [junit4]   2> Caused by: java.net.SocketTimeoutException: Read timed out
   [junit4]   2> 	at java.net.SocketInputStream.socketRead0(Native Method)
   [junit4]   2> 	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   [junit4]   2> 	at java.net.SocketInputStream.read(SocketInputStream.java:171)
   [junit4]   2> 	at java.net.SocketInputStream.read(SocketInputStream.java:141)
   [junit4]   2> 	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
   [junit4]   2> 	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
   [junit4]   2> 	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:983)
   [junit4]   2> 	at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:940)
   [junit4]   2> 	at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
   [junit4]   2> 	at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
   [junit4]   2> 	at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
   [junit4]   2> 	at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 6 more
   [junit4]   2> 
   [junit4]   2> 494672 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy Replay not started, or was not successful... still buffering updates.
   [junit4]   2> 494672 ERROR (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy Recovery failed - trying again... (0)
   [junit4]   2> 494672 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy Wait [2.0] seconds before trying to recover again (attempt=1)
   [junit4]   2> 504672 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[testLeaderNotResponding_shard1_replica_n3]
   [junit4]   2> 504673 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.u.UpdateLog Restarting buffering. previous=RecoveryInfo{adds=0 deletes=0 deleteByQuery=0 errors=0 positionOfStart=0}
   [junit4]   2> 504673 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=BUFFERING, tlog=null}
   [junit4]   2> 504673 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy Publishing state of core [testLeaderNotResponding_shard1_replica_n3] as recovering, leader is [https://127.0.0.1:32807/solr/testLeaderNotResponding_shard1_replica_n1/] and I am [https://127.0.0.1:37453/solr/testLeaderNotResponding_shard1_replica_n3/]
   [junit4]   2> 504674 INFO  (recoveryExecutor-500-thread-1-processing-n:127.0.0.1:37453_solr x:testLeaderNotResponding_shard1_replica_n3 s:shard1 c:testLeaderNotResponding r:core_node4) [n:127.0.0.1:37453_solr c:testLeaderNotResponding s:shard1 r:core_node4 x:testLeaderNotResponding_shard1_replica_n3] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:32807/solr]; [WaitForState: action=PREPRECOVERY&core=testLeaderNotResponding_shard1_replica_n1&nodeName=127.0.0.1:37453_solr&coreNodeName=core_node4&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 504674 INFO  (zkCallback-509-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 504674 INFO  (zkCallback-498-thread-2-processing-n:127.0.0.1:32807_solr) [n:127.0.0.1:32807_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 504674 INFO  (zkCallback-502-thread-3-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderNotResponding/state.json] for collection [testLeaderNotResponding] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 504674 INFO  (zkCallback-502-thread-2-processing-n:127.0.0.1:37453_solr) [n:127.0.0.1:37453_s

[...truncated too long message...]

ing-n:127.0.0.1:39871_solr x:testLeaderUnloaded_shard1_replica_n5 s:shard1 c:testLeaderUnloaded r:core_node6) [n:127.0.0.1:39871_solr c:testLeaderUnloaded s:shard1 r:core_node6 x:testLeaderUnloaded_shard1_replica_n5] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testLeaderUnloaded.shard1.replica_n5, tag=1290622736
   [junit4]   2> 541755 INFO  (recoveryExecutor-514-thread-1-processing-n:127.0.0.1:39871_solr x:testLeaderUnloaded_shard1_replica_n5 s:shard1 c:testLeaderUnloaded r:core_node6) [n:127.0.0.1:39871_solr c:testLeaderUnloaded s:shard1 r:core_node6 x:testLeaderUnloaded_shard1_replica_n5] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2e9ecee2: rootName = null, domain = solr.core.testLeaderUnloaded.shard1.replica_n5, service url = null, agent id = null] for registry solr.core.testLeaderUnloaded.shard1.replica_n5 / com.codahale.metrics.MetricRegistry@3d7bdfd7
   [junit4]   2> 541761 INFO  (recoveryExecutor-514-thread-1-processing-n:127.0.0.1:39871_solr x:testLeaderUnloaded_shard1_replica_n5 s:shard1 c:testLeaderUnloaded r:core_node6) [n:127.0.0.1:39871_solr c:testLeaderUnloaded s:shard1 r:core_node6 x:testLeaderUnloaded_shard1_replica_n5] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testLeaderUnloaded.shard1.leader, tag=1290622736
   [junit4]   2> 541761 WARN  (recoveryExecutor-514-thread-1-processing-n:127.0.0.1:39871_solr x:testLeaderUnloaded_shard1_replica_n5 s:shard1 c:testLeaderUnloaded r:core_node6) [n:127.0.0.1:39871_solr c:testLeaderUnloaded s:shard1 r:core_node6 x:testLeaderUnloaded_shard1_replica_n5] o.a.s.c.RecoveryStrategy Stopping recovery for core=[testLeaderUnloaded_shard1_replica_n5] coreNodeName=[core_node6]
   [junit4]   2> 541766 INFO  (jetty-closer-491-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@8f5dfa9{/solr,null,UNAVAILABLE}
   [junit4]   2> 555057 INFO  (qtp538985609-3321) [n:127.0.0.1:32807_solr    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 13 s
   [junit4]   2> 555057 ERROR (qtp538985609-3321) [n:127.0.0.1:32807_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Solr is shutting down
   [junit4]   2> 	at org.apache.solr.handler.admin.PrepRecoveryOp.execute(PrepRecoveryOp.java:171)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 555057 INFO  (qtp538985609-3321) [n:127.0.0.1:32807_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:37453_solr&onlyIfLeaderActive=true&core=testLeaderNotResponding_shard1_replica_n1&coreNodeName=core_node4&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=400 QTime=78401
   [junit4]   2> 555058 ERROR (SUITE-TestPrepRecovery-seed#[E9B5B9085E370499]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 555058 INFO  (SUITE-TestPrepRecovery-seed#[E9B5B9085E370499]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44103 44103
   [junit4]   2> 561863 INFO  (Thread-882) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44103 44103
   [junit4]   2> 561863 WARN  (Thread-882) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	3	/solr/configs/testLeaderUnloaded/managed-schema
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 	3	/solr/configs/testLeaderUnloaded
   [junit4]   2> 	2	/solr/configs/testLeaderNotResponding
   [junit4]   2> 	2	/solr/configs/testLeaderNotResponding/managed-schema
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	20	/solr/collections/testLeaderUnloaded/state.json
   [junit4]   2> 	17	/solr/collections/testLeaderNotResponding/state.json
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/overseer_elect/election/98932372908212230-127.0.0.1:37453_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/live_nodes
   [junit4]   2> 	4	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPrepRecovery_E9B5B9085E370499-001
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@6b68ea0a), locale=ja-JP-u-ca-japanese-x-lvariant-JP, timezone=Europe/Uzhgorod
   [junit4]   2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=232223384,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestSubQueryTransformerCrossCore, TestBulkSchemaConcurrent, CdcrRequestHandlerTest, TestUniqueKeyFieldResource, TestSimpleQParserPlugin, OverriddenZkACLAndCredentialsProvidersTest, TestQuerySenderNoQuery, TestSizeLimitedDistributedMap, TestAnalyzedSuggestions, TestStressRecovery, TestHdfsBackupRestoreCore, NotRequiredUniqueKeyTest, TermVectorComponentDistributedTest, TestUninvertingReader, InfoHandlerTest, TestCorePropertiesReload, SampleTest, TestCollationFieldDocValues, SecurityConfHandlerTest, OpenExchangeRatesOrgProviderTest, TestLeaderElectionZkExpiry, TestCustomSort, DistribDocExpirationUpdateProcessorTest, ConcurrentDeleteAndCreateCollectionTest, TestConfigSetsAPIExclusivity, TestSchemaManager, ReplaceNodeTest, ChaosMonkeySafeLeaderWithPullReplicasTest, TestTolerantUpdateProcessorCloud, TestSolrQueryResponse, TestStressInPlaceUpdates, TestSolrQueryParser, ClusterStateUpdateTest, TestSolrCloudWithKerberosAlt, TestRemoteStreaming, SolrJmxReporterCloudTest, TestExclusionRuleCollectionAccess, CircularListTest, DOMUtilTest, DistributedTermsComponentTest, PreAnalyzedUpdateProcessorTest, TestDocSet, SuggestComponentTest, TestPrepRecovery]
   [junit4] Completed [165/747 (1!)] on J1 in 89.29s, 2 tests, 1 error <<< FAILURES!

[...truncated 49120 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.1) - Build # 20799 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20799/
Java: 64bit/jdk-9.0.1 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC --illegal-access=deny

1 tests failed.
FAILED:  org.apache.solr.cloud.TestConfigSetsAPI.testUpload

Error Message:
Error from server at https://127.0.0.1:41325/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:41325/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([335621ECA7A88633:30EC71ED44CACEB9]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.TestConfigSetsAPI.createCollection(TestConfigSetsAPI.java:512)
	at org.apache.solr.cloud.TestConfigSetsAPI.testUpload(TestConfigSetsAPI.java:327)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1791 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J2-20171101_223119_82914247817696112274691.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J0-20171101_223119_82613888394393652221541.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J1-20171101_223119_8295413607135341777072.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 290 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J1-20171101_223803_0678414131271135006255.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J2-20171101_223803_0677334979382883965504.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J0-20171101_223803_06714860052598362994136.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1057 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20171101_223919_6948488903174603507795.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20171101_223919_69418275935625432583000.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20171101_223919_6949968848674741151924.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 228 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20171101_224059_98111028160093368391363.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20171101_224059_98112887478095767514822.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20171101_224059_98115072197811630981118.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 243 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20171101_224110_2938293156533197956974.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20171101_224110_29310838958989652008070.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 12 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20171101_224110_2936209278647384682047.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 154 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20171101_224132_17613251091560030933140.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20171101_224132_1766909173581401985767.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20171101_224132_17611752504306299467849.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 166 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20171101_224135_2903263049775367403760.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20171101_224135_29011312428673498200109.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20171101_224135_29013241617081065089299.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 153 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20171101_224144_28513259567086754095656.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20171101_224144_2858929317243370537345.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 157 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20171101_224151_09014483997879428003042.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20171101_224151_090211044002549124557.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20171101_224151_09016915677617085910958.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 169 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20171101_224154_36712152307231858921620.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 148 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20171101_224201_4681394795860955324173.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20171101_224201_4688730514423168890994.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 19 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20171101_224201_4688098647534973157934.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1258 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J2-20171101_224215_34515227832155134331803.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J1-20171101_224215_3454688612849927945398.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J0-20171101_224215_34514670848050463188959.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 230 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J1-20171101_224223_34314762983158979065196.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J0-20171101_224223_343390567094411240937.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J2-20171101_224223_34314521543475822448845.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 254 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20171101_224232_43513319051877680721059.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J1-20171101_224232_43510701369913488380224.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 7 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J0-20171101_224232_43511458056374717935350.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 238 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J0-20171101_224443_8712087809141792942399.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J2-20171101_224443_8718610902709472112908.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J1-20171101_224443_87111304258890252154185.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 170 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J2-20171101_224446_44114842344113904872767.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J1-20171101_224446_44112413059868460788970.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J0-20171101_224446_44117877976358529254516.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 226 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J0-20171101_224451_40617664845894738968197.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J1-20171101_224451_40617161235601502283007.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J2-20171101_224451_4064450507658249881306.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 179 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J1-20171101_224527_11011721891346908125710.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J0-20171101_224527_11012734226588213809178.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J2-20171101_224527_110649804849530565453.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 240 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J1-20171101_224541_81715738560089269102306.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J2-20171101_224541_81716297639588605984621.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J0-20171101_224541_8179107262829492709854.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 160 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J1-20171101_224601_45515745188585665095818.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J0-20171101_224601_3728338611385850663096.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J2-20171101_224601_45514275482499911680693.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 149 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J0-20171101_224637_8717088382885045433432.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J1-20171101_224637_87113240115156390877522.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 177 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J1-20171101_224646_53413590163384652486998.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J2-20171101_224646_5349687276256749209836.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J0-20171101_224646_53417278622808990682616.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 312 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J1-20171101_224701_90215136107435618910904.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J2-20171101_224701_90210546610616353531375.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J0-20171101_224701_9028753239473041673997.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 230 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J0-20171101_224709_84612395181424016203607.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J1-20171101_224709_8484545618632374555278.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J2-20171101_224709_84815661933013529820934.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 207 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J1-20171101_224718_0101028334938904949471.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J0-20171101_224718_01011932254598091968200.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J2-20171101_224718_0107239403629435781497.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 216 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J0-20171101_224729_1925813015565061763056.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 7 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J1-20171101_224729_1927790409150509231604.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J2-20171101_224729_19213516024201631206408.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 418 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20171101_224814_0115709409686766234436.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20171101_224814_01114269679534310113323.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20171101_224814_01116781625480584349957.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 148 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial/test/temp/junit4-J0-20171101_224828_0366016129507142650504.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 166 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20171101_224829_7788937427354146320164.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20171101_224829_7784452758950985184936.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 11 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20171101_224829_7789243077778431300646.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 235 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J2-20171101_224922_73514255880131360814378.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 18 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J0-20171101_224922_73418154184058896445552.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J1-20171101_224922_73412977869039195304798.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 2563 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestConfigSetsAPI
   [junit4]   2> 718944 INFO  (SUITE-TestConfigSetsAPI-seed#[335621ECA7A88633]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestConfigSetsAPI_335621ECA7A88633-001/init-core-data-001
   [junit4]   2> 718945 WARN  (SUITE-TestConfigSetsAPI-seed#[335621ECA7A88633]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=32 numCloses=32
   [junit4]   2> 718945 INFO  (SUITE-TestConfigSetsAPI-seed#[335621ECA7A88633]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 718945 INFO  (SUITE-TestConfigSetsAPI-seed#[335621ECA7A88633]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 718946 INFO  (TEST-TestConfigSetsAPI.testList-seed#[335621ECA7A88633]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testList
   [junit4]   2> 718946 INFO  (TEST-TestConfigSetsAPI.testList-seed#[335621ECA7A88633]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestConfigSetsAPI_335621ECA7A88633-001/tempDir-001
   [junit4]   2> 718947 INFO  (TEST-TestConfigSetsAPI.testList-seed#[335621ECA7A88633]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 718947 INFO  (Thread-1151) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 718947 INFO  (Thread-1151) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 718949 ERROR (Thread-1151) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 719047 INFO  (TEST-TestConfigSetsAPI.testList-seed#[335621ECA7A88633]) [    ] o.a.s.c.ZkTestServer start zk server on port:41853
   [junit4]   2> 719051 INFO  (jetty-launcher-1408-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 719052 INFO  (jetty-launcher-1408-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6056b207{/solr,null,AVAILABLE}
   [junit4]   2> 719053 INFO  (jetty-launcher-1408-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3c542922{SSL,[ssl, http/1.1]}{127.0.0.1:41683}
   [junit4]   2> 719053 INFO  (jetty-launcher-1408-thread-1) [    ] o.e.j.s.Server Started @720953ms
   [junit4]   2> 719053 INFO  (jetty-launcher-1408-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41683}
   [junit4]   2> 719054 ERROR (jetty-launcher-1408-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 719054 INFO  (jetty-launcher-1408-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 719054 INFO  (jetty-launcher-1408-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 719054 INFO  (jetty-launcher-1408-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 719054 INFO  (jetty-launcher-1408-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T23:02:21.886240Z
   [junit4]   2> 719055 INFO  (jetty-launcher-1408-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 719058 INFO  (jetty-launcher-1408-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41853/solr
   [junit4]   2> 719085 INFO  (jetty-launcher-1408-thread-1) [n:127.0.0.1:41683_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 719085 INFO  (jetty-launcher-1408-thread-1) [n:127.0.0.1:41683_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41683_solr
   [junit4]   2> 719085 INFO  (jetty-launcher-1408-thread-1) [n:127.0.0.1:41683_solr    ] o.a.s.c.Overseer Overseer (id=98931660670828547-127.0.0.1:41683_solr-n_0000000000) starting
   [junit4]   2> 719087 INFO  (jetty-launcher-1408-thread-1) [n:127.0.0.1:41683_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41683_solr
   [junit4]   2> 719088 INFO  (OverseerStateUpdate-98931660670828547-127.0.0.1:41683_solr-n_0000000000) [n:127.0.0.1:41683_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 719116 INFO  (jetty-launcher-1408-thread-1) [n:127.0.0.1:41683_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41683.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f6530ca
   [junit4]   2> 719121 INFO  (jetty-launcher-1408-thread-1) [n:127.0.0.1:41683_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41683.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f6530ca
   [junit4]   2> 719121 INFO  (jetty-launcher-1408-thread-1) [n:127.0.0.1:41683_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41683.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f6530ca
   [junit4]   2> 719122 INFO  (jetty-launcher-1408-thread-1) [n:127.0.0.1:41683_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestConfigSetsAPI_335621ECA7A88633-001/tempDir-001/node1/.
   [junit4]   2> 719142 INFO  (qtp1470121744-5501) [n:127.0.0.1:41683_solr    ] o.a.s.h.a.ConfigSetsHandler Invoked ConfigSet Action :list with params action=LIST&wt=javabin&version=2 
   [junit4]   2> 719142 INFO  (qtp1470121744-5501) [n:127.0.0.1:41683_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/configs params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 719153 INFO  (qtp1470121744-5506) [n:127.0.0.1:41683_solr    ] o.a.s.h.a.ConfigSetsHandler Invoked ConfigSet Action :list with params action=LIST&wt=javabin&version=2 
   [junit4]   2> 719153 INFO  (qtp1470121744-5506) [n:127.0.0.1:41683_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/configs params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 719154 INFO  (jetty-closer-1409-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@3c542922{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 719154 INFO  (jetty-closer-1409-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=813896976
   [junit4]   2> 719154 INFO  (jetty-closer-1409-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 719155 INFO  (jetty-closer-1409-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@44be4f70: rootName = solr_41683, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@19671e17
   [junit4]   2> 719157 INFO  (jetty-closer-1409-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 719158 INFO  (jetty-closer-1409-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@32bc057d: rootName = solr_41683, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5b773177
   [junit4]   2> 719160 INFO  (jetty-closer-1409-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 719160 INFO  (jetty-closer-1409-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@666e719: rootName = solr_41683, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@3a347dae
   [junit4]   2> 719161 INFO  (jetty-closer-1409-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:41683_solr
   [junit4]   2> 719161 INFO  (jetty-closer-1409-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 719161 INFO  (zkCallback-1415-thread-1-processing-n:127.0.0.1:41683_solr) [n:127.0.0.1:41683_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 719161 INFO  (jetty-closer-1409-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 719161 INFO  (jetty-closer-1409-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98931660670828547-127.0.0.1:41683_solr-n_0000000000) closing
   [junit4]   2> 719161 WARN  (OverseerAutoScalingTriggerThread-98931660670828547-127.0.0.1:41683_solr-n_0000000000) [n:127.0.0.1:41683_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 719161 INFO  (OverseerStateUpdate-98931660670828547-127.0.0.1:41683_solr-n_0000000000) [n:127.0.0.1:41683_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41683_solr
   [junit4]   2> 719162 INFO  (jetty-closer-1409-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6056b207{/solr,null,UNAVAILABLE}
   [junit4]   2> 719162 ERROR (TEST-TestConfigSetsAPI.testList-seed#[335621ECA7A88633]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 719162 INFO  (TEST-TestConfigSetsAPI.testList-seed#[335621ECA7A88633]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41853 41853
   [junit4]   2> 724183 INFO  (Thread-1151) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41853 41853
   [junit4]   2> 724184 INFO  (TEST-TestConfigSetsAPI.testList-seed#[335621ECA7A88633]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testList
   [junit4]   2> 724185 INFO  (TEST-TestConfigSetsAPI.testUploadErrors-seed#[335621ECA7A88633]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testUploadErrors
   [junit4]   2> 724185 INFO  (TEST-TestConfigSetsAPI.testUploadErrors-seed#[335621ECA7A88633]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestConfigSetsAPI_335621ECA7A88633-001/tempDir-002
   [junit4]   2> 724185 INFO  (TEST-TestConfigSetsAPI.testUploadErrors-seed#[335621ECA7A88633]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 724189 INFO  (Thread-1162) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 724189 INFO  (Thread-1162) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 724194 ERROR (Thread-1162) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 724289 INFO  (TEST-TestConfigSetsAPI.testUploadErrors-seed#[335621ECA7A88633]) [    ] o.a.s.c.ZkTestServer start zk server on port:42363
   [junit4]   2> 724299 INFO  (jetty-launcher-1426-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 724357 INFO  (jetty-launcher-1426-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6595711b{/solr,null,AVAILABLE}
   [junit4]   2> 724358 INFO  (jetty-launcher-1426-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2ff61570{SSL,[ssl, http/1.1]}{127.0.0.1:37631}
   [junit4]   2> 724358 INFO  (jetty-launcher-1426-thread-1) [    ] o.e.j.s.Server Started @726258ms
   [junit4]   2> 724358 INFO  (jetty-launcher-1426-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37631}
   [junit4]   2> 724358 ERROR (jetty-launcher-1426-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 724358 INFO  (jetty-launcher-1426-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 724358 INFO  (jetty-launcher-1426-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 724358 INFO  (jetty-launcher-1426-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 724359 INFO  (jetty-launcher-1426-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T23:02:27.190988Z
   [junit4]   2> 724363 INFO  (jetty-launcher-1426-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 724374 INFO  (jetty-launcher-1426-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42363/solr
   [junit4]   2> 724441 INFO  (jetty-launcher-1426-thread-1) [n:127.0.0.1:37631_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 724441 INFO  (jetty-launcher-1426-thread-1) [n:127.0.0.1:37631_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37631_solr
   [junit4]   2> 724442 INFO  (jetty-launcher-1426-thread-1) [n:127.0.0.1:37631_solr    ] o.a.s.c.Overseer Overseer (id=98931661014433795-127.0.0.1:37631_solr-n_0000000000) starting
   [junit4]   2> 724450 INFO  (jetty-launcher-1426-thread-1) [n:127.0.0.1:37631_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37631_solr
   [junit4]   2> 724451 INFO  (zkCallback-1433-thread-1-processing-n:127.0.0.1:37631_solr) [n:127.0.0.1:37631_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 724502 INFO  (jetty-launcher-1426-thread-1) [n:127.0.0.1:37631_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37631.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f6530ca
   [junit4]   2> 724507 INFO  (jetty-launcher-1426-thread-1) [n:127.0.0.1:37631_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37631.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f6530ca
   [junit4]   2> 724507 INFO  (jetty-launcher-1426-thread-1) [n:127.0.0.1:37631_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37631.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f6530ca
   [junit4]   2> 724508 INFO  (jetty-launcher-1426-thread-1) [n:127.0.0.1:37631_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestConfigSetsAPI_335621ECA7A88633-001/tempDir-002/node1/.
   [junit4]   2> 724536 ERROR (qtp853510491-5566) [n:127.0.0.1:37631_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: The configuration name should be provided in the "name" parameter
   [junit4]   2> 	at org.apache.solr.handler.admin.ConfigSetsHandler.handleConfigUploadRequest(ConfigSetsHandler.java:142)
   [junit4]   2> 	at org.apache.solr.handler.admin.ConfigSetsHandler.handleRequestBody(ConfigSetsHandler.java:110)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 724536 INFO  (qtp853510491-5566) [n:127.0.0.1:37631_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/configs params={action=UPLOAD} status=400 QTime=0
   [junit4]   2> 724546 ERROR (qtp853510491-5572) [n:127.0.0.1:37631_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: The configuration myconf already exists in zookeeper
   [junit4]   2> 	at org.apache.solr.handler.admin.ConfigSetsHandler.handleConfigUploadRequest(ConfigSetsHandler.java:150)
   [junit4]   2> 	at org.apache.solr.handler.admin.ConfigSetsHandler.handleRequestBody(ConfigSetsHandler.java:110)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 724546 INFO  (qtp853510491-5572) [n:127.0.0.1:37631_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/configs params={name=myconf&action=UPLOAD} status=400 QTime=2
   [junit4]   2> 724565 INFO  (jetty-closer-1427-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@2ff61570{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 724565 INFO  (jetty-closer-1427-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1659755573
   [junit4]   2> 724565 INFO  (jetty-closer-1427-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 724565 INFO  (jetty-closer-1427-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5658789: rootName = solr_37631, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1f72abdb
   [junit4]   2> 724571 INFO  (jetty-closer-1427-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 724572 INFO  (jetty-closer-1427-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3252d764: rootName = solr_37631, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5b773177
   [junit4]   2> 724577 INFO  (jetty-closer-1427-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 724577 INFO  (jetty-closer-1427-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@78bbd96b: rootName = solr_37631, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@3a347dae
   [junit4]   2> 724578 INFO  (jetty-closer-1427-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37631_solr
   [junit4]   2> 724579 INFO  (jetty-closer-1427-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 724579 INFO  (zkCallback-1433-thread-1-processing-n:127.0.0.1:37631_solr) [n:127.0.0.1:37631_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 724579 INFO  (jetty-closer-1427-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 724579 INFO  (jetty-closer-1427-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98931661014433795-127.0.0.1:37631_solr-n_0000000000) closing
   [junit4]   2> 724580 WARN  (OverseerAutoScalingTriggerThread-98931661014433795-127.0.0.1:37631_solr-n_0000000000) [n:127.0.0.1:37631_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 724580 INFO  (OverseerStateUpdate-98931661014433795-127.0.0.1:37631_solr-n_0000000000) [n:127.0.0.1:37631_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37631_solr
   [junit4]   2> 724582 INFO  (jetty-closer-1427-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6595711b{/solr,null,UNAVAILABLE}
   [junit4]   2> 724585 ERROR (TEST-TestConfigSetsAPI.testUploadErrors-seed#[335621ECA7A88633]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 724586 INFO  (TEST-TestConfigSetsAPI.testUploadErrors-seed#[335621ECA7A88633]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42363 42363
   [junit4]   2> 729627 INFO  (Thread-1162) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42363 42363
   [junit4]   2> 729628 INFO  (TEST-TestConfigSetsAPI.testUploadErrors-seed#[335621ECA7A88633]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testUploadErrors
   [junit4]   2> 729629 INFO  (TEST-TestConfigSetsAPI.testCreateErrors-seed#[335621ECA7A88633]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCreateErrors
   [junit4]   2> 729629 INFO  (TEST-TestConfigSetsAPI.testCreateErrors-seed#[335621ECA7A88633]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestConfigSetsAPI_335621ECA7A88633-001/tempDir-003
   [junit4]   2> 729630 INFO  (TEST-TestConfigSetsAPI.testCreateErrors-seed#[335621ECA7A88633]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 729631 INFO  (Thread-1172) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 729631 INFO  (Thread-1172) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 729633 ERROR (Thread-1172) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 729731 INFO  (TEST-TestConfigSetsAPI.testCreateErrors-seed#[335621ECA7A88633]) [    ] o.a.s.c.ZkTestServer start zk server on port:40487
   [junit4]   2> 729735 INFO  (jetty-launcher-1439-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 729736 INFO  (jetty-launcher-1439-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@388a4a32{/solr,null,AVAILABLE}
   [junit4]   2> 729736 INFO  (jetty-launcher-1439-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@450a161a{SSL,[ssl, http/1.1]}{127.0.0.1:45593}
   [junit4]   2> 729736 INFO  (jetty-launcher-1439-thread-1) [    ] o.e.j.s.Server Started @731636ms
   [junit4]   2> 729736 INFO  (jetty-launcher-1439-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45593}
   [junit4]   2> 729736 ERROR (jetty-launcher-1439-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 729736 INFO  (jetty-launcher-1439-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 729736 INFO  (jetty-launcher-1439-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 729736 INFO  (jetty-launcher-1439-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 729736 INFO  (jetty-launcher-1439-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T23:02:32.568969Z
   [junit4]   2> 729738 INFO  (jetty-launcher-1439-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 729745 INFO  (jetty-launcher-1439-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40487/solr
   [junit4]   2> 729778 INFO  (jetty-launcher-1439-thread-1) [n:127.0.0.1:45593_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 729779 INFO  (jetty-launcher-1439-thread-1) [n:127.0.0.1:45593_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45593_solr
   [junit4]   2> 729779 INFO  (jetty-launcher-1439-thread-1) [n:127.0.0.1:45593_solr    ] o.a.s.c.Overseer Overseer (id=98931661371080707-127.0.0.1:45593_solr-n_0000000000) starting
   [junit4]   2> 729786 INFO  (jetty-launcher-1439-thread-1) [n:127.0.0.1:45593_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45593_solr
   [junit4]   2> 729787 INFO  (zkCallback-1446-thread-1-processing-n:127.0.0.1:45593_solr) [n:127.0.0.1:45593_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 729824 INFO  (jetty-launcher-1439-thread-1) [n:127.0.0.1:45593_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45593.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f6530ca
   [junit4]   2> 729832 INFO  (jetty-launcher-1439-thread-1) [n:127.0.0.1:45593_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45593.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f6530ca
   [junit4]   2> 729832 INFO  (jetty-launcher-1439-thread-1) [n:127.0.0.1:45593_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45593.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f6530ca
   [junit4]   2> 729833 INFO  (jetty-launcher-1439-thread-1) [n:127.0.0.1:45593_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestConfigSetsAPI_335621ECA7A88633-001/tempDir-003/node1/.
   [junit4]   2> 729856 ERROR (qtp1326797245-5613) [n:127.0.0.1:45593_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: action is a required param
   [junit4]   2> 	at org.apache.solr.handler.admin.ConfigSetsHandler.handleRequestBody(ConfigSetsHandler.java:115)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 729856 INFO  (qtp1326797245-5613) [n:127.0.0.1:45593_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/configs params={wt=javabin&version=2} status=400 QTime=0
   [junit4]   2> 729857 INFO  (qtp1326797245-5618) [n:127.0.0.1:45593_solr    ] o.a.s.h.a.ConfigSetsHandler Invoked ConfigSet Action :create with params action=CREATE&wt=javabin&version=2 
   [junit4]   2> 729857 ERROR (qtp1326797245-5618) [n:127.0.0.1:45593_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Missing required parameter: name
   [junit4]   2> 	at org.apache.solr.common.params.RequiredSolrParams.getParams(RequiredSolrParams.java:90)
   [junit4]   2> 	at org.apache.solr.common.params.SolrParams.getAll(SolrParams.java:462)
   [junit4]   2> 	at org.apache.solr.common.params.SolrParams.getAll(SolrParams.java:479)
   [junit4]   2> 	at org.apache.solr.handler.admin.ConfigSetsHandler$ConfigSetOperation$1.call(ConfigSetsHandler.java:261)
   [junit4]   2> 	at org.apache.solr.handler.admin.ConfigSetsHandler.invokeAction(ConfigSetsHandler.java:124)
   [junit4]   2> 	at org.apache.solr.handler.admin.ConfigSetsHandler.handleRequestBody(ConfigSetsHandler.java:113)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 729858 INFO  (qtp1326797245-5618) [n:127.0.0.1:45593_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/configs params={action=CREATE&wt=javabin&version=2} status=400 QTime=0
   [junit4]   2> 729858 INFO  (qtp1326797245-5619) [n:127.0.0.1:45593_solr    ] o.a.s.h.a.ConfigSetsHandler Invoked ConfigSet Action :create with params name=configSetName&action=CREATE&wt=javabin&version=2 
   [junit4]   2> 729858 ERROR (qtp1326797245-5619) [n:127.0.0.1:45593_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Missing required parameter: baseConfigSet
   [junit4]   2> 	at org.apache.solr.common.params.RequiredSolrParams.getParams(RequiredSolrParams.java:90)
   [junit4]   2> 	at org.apache.solr.common.params.SolrParams.getAll(SolrParams.java:462)
   [junit4]   2> 	at org.apache.solr.common.params.SolrParams.getAll(SolrParams.java:479)
   [junit4]   2> 	at org.apache.solr.handler.admin.ConfigSetsHandler$ConfigSetOperation$1.call(ConfigSetsHandler.java:261)
   [junit4]   2> 	at org.apache.solr.handler.admin.ConfigSetsHandler.invokeAction(ConfigSetsHandler.java:124)
   [junit4]   2> 	at org.apache.solr.handler.admin.ConfigSetsHandler.handleRequestBody(ConfigSetsHandler.java:113)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 729858 INFO  (qtp1326797245-5619) [n:127.0.0.1:45593_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/configs params={name=configSetName&action=CREATE&wt=javabin&version=2} status=400 QTime=0
   [junit4]   2> 729859 INFO  (qtp1326797245-5620) [n:127.0.0.1:45593_solr    ] o.a.s.h.a.ConfigSetsHandler Invoked ConfigSet Action :create with params baseConfigSet=baseConfigSet&name=configSet&action=CREATE&wt=javabin&version=2 
   [junit4]   2> 729861 INFO  (OverseerThreadFactory-2497-thread-1-processing-n:127.0.0.1:45593_solr) [n:127.0.0.1:45593_solr    ] o.a.s.c.OverseerConfigSetMessageHandler OverseerConfigSetMessageHandler.processMessage : create , {
   [junit4]   2>   "name":"configSet",
   [junit4]   2>   "baseConfigSet":"baseConfigSet",
   [junit4]   2>   "immutable":"false",
   [junit4]   2>   "operation":"configsets:create"}
   [junit4]   2> 729861 ERROR (OverseerThreadFactor

[...truncated too long message...]

ns/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J2-20171101_233956_1742970732818254111669.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J1-20171101_233956_1749691491003536175837.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 553 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20171101_234102_3329926740468562146257.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20171101_234102_3327102189393888904359.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20171101_234102_3325162118356254765347.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1259 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20171101_234119_663474061439342027727.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20171101_234119_659427063790107340887.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 644 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20171101_234127_38912494618353484208483.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20171101_234127_38911972433847117593980.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20171101_234127_3899961113088279448867.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 557 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20171101_234152_0624792964675020944224.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20171101_234152_0624297073812181558212.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20171101_234152_062606979031798752154.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 563 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20171101_234204_5882346307047092855343.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20171101_234204_5882559480253864750643.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 646 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20171101_234212_17511146281380029377715.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20171101_234212_17515606098596615584367.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20171101_234212_1751563823168553907143.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 596 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20171101_234244_4814028680452807614127.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20171101_234244_48114459680350409450018.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 548 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20171101_234254_83116804523533544476870.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 31612 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20798 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20798/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseG1GC

4 tests failed.
FAILED:  org.apache.solr.cloud.DeleteShardTest.testDirectoryCleanupAfterDeleteShard

Error Message:
Error from server at http://127.0.0.1:37157/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37157/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([C6169F184BF90CF9:660CD443EF8947F5]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.cloud.DeleteShardTest.testDirectoryCleanupAfterDeleteShard(DeleteShardTest.java:110)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteShardTest.test

Error Message:
Error from server at http://127.0.0.1:37157/solr: Could not fully create collection: deleteShard

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37157/solr: Could not fully create collection: deleteShard
	at __randomizedtesting.SeedInfo.seed([C6169F184BF90CF9:4E42A0C2E5056101]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.cloud.DeleteShardTest.test(DeleteShardTest.java:57)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestStressInPlaceUpdates.stressTest

Error Message:
Timeout occured while waiting response from server at: https://127.0.0.1:44795

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:44795
	at __randomizedtesting.SeedInfo.seed([C6169F184BF90CF9:AD7040B5752CD803]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:315)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:983)
	at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:940)
	at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
	at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
	at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
	at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 43 more


FAILED:  org.apache.solr.security.PKIAuthenticationIntegrationTest.testPkiAuth

Error Message:
Error from server at http://127.0.0.1:35237/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35237/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([C6169F184BF90CF9:F6A80649AB4F8B58]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.security.PKIAuthenticationIntegrationTest.testPkiAuth(PKIAuthenticationIntegrationTest.java:58)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12540 lines...]
   [junit4] Suite: org.apache.solr.cloud.DeleteShardTest
   [junit4]   2> 835370 INFO  (SUITE-DeleteShardTest-seed#[C6169F184BF90CF9]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteShardTest_C6169F184BF90CF9-001/init-core-data-001
   [junit4]   2> 835370 WARN  (SUITE-DeleteShardTest-seed#[C6169F184BF90CF9]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 835370 INFO  (SUITE-DeleteShardTest-seed#[C6169F184BF90CF9]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 835371 INFO  (SUITE-DeleteShardTest-seed#[C6169F184BF90CF9]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 835371 INFO  (SUITE-DeleteShardTest-seed#[C6169F184BF90CF9]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteShardTest_C6169F184BF90CF9-001/tempDir-001
   [junit4]   2> 835372 INFO  (SUITE-DeleteShardTest-seed#[C6169F184BF90CF9]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 835372 INFO  (Thread-3490) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 835372 INFO  (Thread-3490) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 835373 ERROR (Thread-3490) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 835472 INFO  (SUITE-DeleteShardTest-seed#[C6169F184BF90CF9]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:39301
   [junit4]   2> 835484 INFO  (jetty-launcher-1192-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 835484 INFO  (jetty-launcher-1192-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 835486 INFO  (jetty-launcher-1192-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@f2eeed{/solr,null,AVAILABLE}
   [junit4]   2> 835490 INFO  (jetty-launcher-1192-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5d2c60{/solr,null,AVAILABLE}
   [junit4]   2> 835497 INFO  (jetty-launcher-1192-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@16af990{HTTP/1.1,[http/1.1]}{127.0.0.1:37157}
   [junit4]   2> 835497 INFO  (jetty-launcher-1192-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@332382{HTTP/1.1,[http/1.1]}{127.0.0.1:44719}
   [junit4]   2> 835497 INFO  (jetty-launcher-1192-thread-1) [    ] o.e.j.s.Server Started @838408ms
   [junit4]   2> 835497 INFO  (jetty-launcher-1192-thread-2) [    ] o.e.j.s.Server Started @838409ms
   [junit4]   2> 835497 INFO  (jetty-launcher-1192-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37157}
   [junit4]   2> 835497 INFO  (jetty-launcher-1192-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44719}
   [junit4]   2> 835498 ERROR (jetty-launcher-1192-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 835498 ERROR (jetty-launcher-1192-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 835498 INFO  (jetty-launcher-1192-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 835498 INFO  (jetty-launcher-1192-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 835498 INFO  (jetty-launcher-1192-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 835498 INFO  (jetty-launcher-1192-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 835498 INFO  (jetty-launcher-1192-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 835498 INFO  (jetty-launcher-1192-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 835498 INFO  (jetty-launcher-1192-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T20:04:23.993Z
   [junit4]   2> 835498 INFO  (jetty-launcher-1192-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T20:04:23.993Z
   [junit4]   2> 835501 INFO  (jetty-launcher-1192-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 835501 INFO  (jetty-launcher-1192-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 835517 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f792f4cbb0002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 835521 INFO  (jetty-launcher-1192-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39301/solr
   [junit4]   2> 835521 INFO  (jetty-launcher-1192-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39301/solr
   [junit4]   2> 835577 INFO  (jetty-launcher-1192-thread-1) [n:127.0.0.1:37157_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 835577 INFO  (jetty-launcher-1192-thread-2) [n:127.0.0.1:44719_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 835578 INFO  (jetty-launcher-1192-thread-1) [n:127.0.0.1:37157_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37157_solr
   [junit4]   2> 835578 INFO  (jetty-launcher-1192-thread-2) [n:127.0.0.1:44719_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44719_solr
   [junit4]   2> 835579 INFO  (jetty-launcher-1192-thread-1) [n:127.0.0.1:37157_solr    ] o.a.s.c.Overseer Overseer (id=98930960883187718-127.0.0.1:37157_solr-n_0000000000) starting
   [junit4]   2> 835579 INFO  (zkCallback-1203-thread-1-processing-n:127.0.0.1:44719_solr) [n:127.0.0.1:44719_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 835580 INFO  (zkCallback-1204-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 835584 INFO  (jetty-launcher-1192-thread-1) [n:127.0.0.1:37157_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37157_solr
   [junit4]   2> 835585 INFO  (zkCallback-1203-thread-1-processing-n:127.0.0.1:44719_solr) [n:127.0.0.1:44719_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 835586 INFO  (zkCallback-1204-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 835673 INFO  (jetty-launcher-1192-thread-2) [n:127.0.0.1:44719_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44719.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@114839d
   [junit4]   2> 835682 INFO  (jetty-launcher-1192-thread-2) [n:127.0.0.1:44719_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44719.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@114839d
   [junit4]   2> 835682 INFO  (jetty-launcher-1192-thread-2) [n:127.0.0.1:44719_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44719.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@114839d
   [junit4]   2> 835684 INFO  (jetty-launcher-1192-thread-2) [n:127.0.0.1:44719_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteShardTest_C6169F184BF90CF9-001/tempDir-001/node2/.
   [junit4]   2> 835976 INFO  (jetty-launcher-1192-thread-1) [n:127.0.0.1:37157_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37157.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@114839d
   [junit4]   2> 835984 INFO  (jetty-launcher-1192-thread-1) [n:127.0.0.1:37157_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37157.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@114839d
   [junit4]   2> 835985 INFO  (jetty-launcher-1192-thread-1) [n:127.0.0.1:37157_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37157.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@114839d
   [junit4]   2> 835986 INFO  (jetty-launcher-1192-thread-1) [n:127.0.0.1:37157_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteShardTest_C6169F184BF90CF9-001/tempDir-001/node1/.
   [junit4]   2> 836013 INFO  (SUITE-DeleteShardTest-seed#[C6169F184BF90CF9]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 836014 INFO  (SUITE-DeleteShardTest-seed#[C6169F184BF90CF9]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39301/solr ready
   [junit4]   2> 836041 INFO  (TEST-DeleteShardTest.testDirectoryCleanupAfterDeleteShard-seed#[C6169F184BF90CF9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDirectoryCleanupAfterDeleteShard
   [junit4]   2> 836043 INFO  (qtp6906490-9482) [n:127.0.0.1:37157_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params shards=a,b,c&replicationFactor=1&collection.configName=conf&maxShardsPerNode=2&name=deleteshard_test&router.name=implicit&nrtReplicas=1&action=CREATE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 836045 INFO  (OverseerThreadFactory-2801-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.CreateCollectionCmd Create collection deleteshard_test
   [junit4]   2> 836155 INFO  (OverseerStateUpdate-98930960883187718-127.0.0.1:37157_solr-n_0000000000) [n:127.0.0.1:37157_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteshard_test",
   [junit4]   2>   "shard":"a",
   [junit4]   2>   "core":"deleteshard_test_a_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37157/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 836158 INFO  (OverseerStateUpdate-98930960883187718-127.0.0.1:37157_solr-n_0000000000) [n:127.0.0.1:37157_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteshard_test",
   [junit4]   2>   "shard":"b",
   [junit4]   2>   "core":"deleteshard_test_b_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:44719/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 836161 INFO  (OverseerStateUpdate-98930960883187718-127.0.0.1:37157_solr-n_0000000000) [n:127.0.0.1:37157_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteshard_test",
   [junit4]   2>   "shard":"c",
   [junit4]   2>   "core":"deleteshard_test_c_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37157/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 836367 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=deleteshard_test_c_replica_n4&action=CREATE&numShards=3&collection=deleteshard_test&shard=c&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 836367 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=deleteshard_test_a_replica_n1&action=CREATE&numShards=3&collection=deleteshard_test&shard=a&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 836367 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=deleteshard_test_b_replica_n2&action=CREATE&numShards=3&collection=deleteshard_test&shard=b&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 836368 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 836368 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 836476 INFO  (zkCallback-1203-thread-1-processing-n:127.0.0.1:44719_solr) [n:127.0.0.1:44719_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteshard_test/state.json] for collection [deleteshard_test] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 836476 INFO  (zkCallback-1204-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteshard_test/state.json] for collection [deleteshard_test] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 836476 INFO  (zkCallback-1204-thread-2-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteshard_test/state.json] for collection [deleteshard_test] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 836476 INFO  (zkCallback-1203-thread-2-processing-n:127.0.0.1:44719_solr) [n:127.0.0.1:44719_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteshard_test/state.json] for collection [deleteshard_test] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 837397 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 837397 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 837397 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 837412 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.s.IndexSchema [deleteshard_test_c_replica_n4] Schema name=minimal
   [junit4]   2> 837412 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.s.IndexSchema [deleteshard_test_a_replica_n1] Schema name=minimal
   [junit4]   2> 837412 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.s.IndexSchema [deleteshard_test_b_replica_n2] Schema name=minimal
   [junit4]   2> 837423 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 837423 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 837423 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'deleteshard_test_b_replica_n2' using configuration from collection deleteshard_test, trusted=true
   [junit4]   2> 837423 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'deleteshard_test_a_replica_n1' using configuration from collection deleteshard_test, trusted=true
   [junit4]   2> 837423 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 837423 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'deleteshard_test_c_replica_n4' using configuration from collection deleteshard_test, trusted=true
   [junit4]   2> 837423 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44719.solr.core.deleteshard_test.b.replica_n2' (registry 'solr.core.deleteshard_test.b.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@114839d
   [junit4]   2> 837423 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37157.solr.core.deleteshard_test.a.replica_n1' (registry 'solr.core.deleteshard_test.a.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@114839d
   [junit4]   2> 837423 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37157.solr.core.deleteshard_test.c.replica_n4' (registry 'solr.core.deleteshard_test.c.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@114839d
   [junit4]   2> 837424 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 837424 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 837424 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 837424 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.SolrCore [[deleteshard_test_a_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteShardTest_C6169F184BF90CF9-001/tempDir-001/node1/deleteshard_test_a_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteShardTest_C6169F184BF90CF9-001/tempDir-001/node1/./deleteshard_test_a_replica_n1/data/]
   [junit4]   2> 837424 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.SolrCore [[deleteshard_test_b_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteShardTest_C6169F184BF90CF9-001/tempDir-001/node2/deleteshard_test_b_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteShardTest_C6169F184BF90CF9-001/tempDir-001/node2/./deleteshard_test_b_replica_n2/data/]
   [junit4]   2> 837424 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.SolrCore [[deleteshard_test_c_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteShardTest_C6169F184BF90CF9-001/tempDir-001/node1/deleteshard_test_c_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteShardTest_C6169F184BF90CF9-001/tempDir-001/node1/./deleteshard_test_c_replica_n4/data/]
   [junit4]   2> 837472 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 837472 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 837472 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 837472 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 837472 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 837472 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 837473 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 837473 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 837474 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 837474 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 837474 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 837474 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 837475 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@926262[deleteshard_test_a_replica_n1] main]
   [junit4]   2> 837475 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@15b75d6[deleteshard_test_c_replica_n4] main]
   [junit4]   2> 837475 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b2608d[deleteshard_test_b_replica_n2] main]
   [junit4]   2> 837476 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 837476 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 837476 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 837476 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 837476 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 837477 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 837477 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 837477 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 837477 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 837478 INFO  (searcherExecutor-2806-thread-1-processing-n:127.0.0.1:44719_solr x:deleteshard_test_b_replica_n2 s:b c:deleteshard_test r:core_node5) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.SolrCore [deleteshard_test_b_replica_n2] Registered new searcher Searcher@1b2608d[deleteshard_test_b_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 837478 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582895376339304448
   [junit4]   2> 837479 INFO  (searcherExecutor-2808-thread-1-processing-n:127.0.0.1:37157_solr x:deleteshard_test_c_replica_n4 s:c c:deleteshard_test r:core_node6) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.SolrCore [deleteshard_test_c_replica_n4] Registered new searcher Searcher@15b75d6[deleteshard_test_c_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 837479 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582895376340353024
   [junit4]   2> 837479 INFO  (searcherExecutor-2807-thread-1-processing-n:127.0.0.1:37157_solr x:deleteshard_test_a_replica_n1 s:a c:deleteshard_test r:core_node3) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.SolrCore [deleteshard_test_a_replica_n1] Registered new searcher Searcher@926262[deleteshard_test_a_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 837479 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582895376340353024
   [junit4]   2> 837483 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 837483 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 837483 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 837483 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 837483 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44719/solr/deleteshard_test_b_replica_n2/
   [junit4]   2> 837483 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 837483 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 837483 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37157/solr/deleteshard_test_a_replica_n1/
   [junit4]   2> 837483 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.SyncStrategy http://127.0.0.1:44719/solr/deleteshard_test_b_replica_n2/ has no replicas
   [junit4]   2> 837483 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 837483 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 837483 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:37157/solr/deleteshard_test_a_replica_n1/ has no replicas
   [junit4]   2> 837483 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 837483 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 837483 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37157/solr/deleteshard_test_c_replica_n4/
   [junit4]   2> 837483 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 837483 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.SyncStrategy http://127.0.0.1:37157/solr/deleteshard_test_c_replica_n4/ has no replicas
   [junit4]   2> 837483 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 837485 INFO  (qtp6906490-9486) [n:127.0.0.1:37157_solr c:deleteshard_test s:a r:core_node3 x:deleteshard_test_a_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37157/solr/deleteshard_test_a_replica_n1/ a
   [junit4]   2> 837485 INFO  (qtp6906490-9474) [n:127.0.0.1:37157_solr c:deleteshard_test s:c r:core_node6 x:deleteshard_test_c_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37157/solr/deleteshard_test_c_replica_n4/ c
   [junit4]   2> 837485 INFO  (qtp3747579-9483) [n:127.0.0.1:44719_solr c:deleteshard_test s:b r:core_node5 x:deleteshard_test_b_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44719/solr/deleteshard_test_b_replica_n2/ b
   [junit4]   2> 1016046 ERROR (qtp6906490-9482) [n:127.0.0.1:37157_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: create the collection time out:180s
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1016047 INFO  (qtp6906490-9482) [n:127.0.0.1:37157_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={shards=a,b,c&replicationFactor=1&collection.configName=conf&maxShardsPerNode=2&name=deleteshard_test&router.name=implicit&nrtReplicas=1&action=CREATE&wt=javabin&version=2} status=500 QTime=180003
   [junit4]   2> 1016047 ERROR (qtp6906490-9482) [n:127.0.0.1:37157_solr    ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: create the collection time out:180s
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1016048 INFO  (TEST-DeleteShardTest.testDirectoryCleanupAfterDeleteShard-seed#[C6169F184BF90CF9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDirectoryCleanupAfterDeleteShard
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DeleteShardTest -Dtests.method=testDirectoryCleanupAfterDeleteShard -Dtests.seed=C6169F184BF90CF9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=et-EE -Dtests.timezone=Europe/Riga -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR    180s J1 | DeleteShardTest.testDirectoryCleanupAfterDeleteShard <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37157/solr: create the collection time out:180s
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([C6169F184BF90CF9:660CD443EF8947F5]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
   [junit4]    > 	at org.apache.solr.cloud.DeleteShardTest.testDirectoryCleanupAfterDeleteShard(DeleteShardTest.java:110)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1016099 INFO  (TEST-DeleteShardTest.test-seed#[C6169F184BF90CF9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 1016101 INFO  (qtp6906490-9484) [n:127.0.0.1:37157_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=deleteShard&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1016104 INFO  (OverseerThreadFactory-2801-thread-2-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.CreateCollectionCmd Create collection deleteShard
   [junit4]   2> 1046129 ERROR (OverseerThreadFactory-2801-thread-2-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.OverseerCollectionMessageHandler Collection: deleteShard operation: create failed:org.apache.solr.common.SolrException: Could not fully create collection: deleteShard
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:215)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1046142 INFO  (qtp6906490-9484) [n:127.0.0.1:37157_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=deleteShard&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=500 QTime=30041
   [junit4]   2> 1046143 ERROR (qtp6906490-9484) [n:127.0.0.1:37157_solr    ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Could not fully create collection: deleteShard
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:307)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1046146 INFO  (TEST-DeleteShardTest.test-seed#[C6169F184BF90CF9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending test
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DeleteShardTest -Dtests.method=test -Dtests.seed=C6169F184BF90CF9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=et-EE -Dtests.timezone=Europe/Riga -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   30.1s J1 | DeleteShardTest.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37157/solr: Could not fully create collection: deleteShard
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([C6169F184BF90CF9:4E42A0C2E5056101]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
   [junit4]    > 	at org.apache.solr.cloud.DeleteShardTest.test(DeleteShardTest.java:57)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1046151 INFO  (jetty-closer-1193-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@332382{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1046151 INFO  (jetty-closer-1193-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=27880084
   [junit4]   2> 1046151 INFO  (jetty-closer-1193-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@16af990{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1046151 INFO  (jetty-closer-1193-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1046152 INFO  (jetty-closer-1193-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=17738299
   [junit4]   2> 1046152 INFO  (jetty-closer-1193-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1584a6: rootName = solr_44719, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@802d8f
   [junit4]   2> 1046152 INFO  (jetty-closer-1193-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1046153 INFO  (jetty-closer-1193-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5b6f1a: rootName = solr_37157, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1d466a7
   [junit4]   2> 1046155 ERROR (OverseerThreadFactory-2801-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:44719/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:44719/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:44719 failed to respond
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 1046159 ERROR (OverseerThreadFactory-2801-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:37157/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:37157/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:37157 failed to respond
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 1046162 ERROR (OverseerThreadFactory-2801-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:37157/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:37157/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:37157 failed to respond
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 1046165 ERROR (OverseerThreadFactory-2801-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [deleteshard_test].
   [junit4]   2> 1046166 INFO  (OverseerThreadFactory-2801-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 1046168 ERROR (OverseerThreadFactory-2801-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:44719/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:44719/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:650)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:44719 [/127.0.0.1] failed: Connection refused (Connection refused)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
   [junit4]   2> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
   [junit4]   2> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]   2> 	at java.net.Socket.connect(Socket.java:589)
   [junit4]   2> 	at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
   [juni

[...truncated too long message...]

 [ecj-lint] 9. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/request/SimpleFacets.java (at line 943)
 [ecj-lint] 	fastForRandomSet = new HashDocSet(sset.getDocs(), 0, sset.size());
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'fastForRandomSet' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 10. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/response/SmileResponseWriter.java (at line 33)
 [ecj-lint] 	new SmileWriter(out, request, response).writeResponse();
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 11. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/schema/OpenExchangeRatesOrgProvider.java (at line 146)
 [ecj-lint] 	ratesJsonStream = resourceLoader.openResource(ratesFileLocation);
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'ratesJsonStream' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 12. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/search/CollapsingQParserPlugin.java (at line 1315)
 [ecj-lint] 	UninvertingReader uninvertingReader = new UninvertingReader(new ReaderWrapper(searcher.getSlowAtomicReader(), collapseField), mapping);
 [ecj-lint] 	                  ^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'uninvertingReader' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 13. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/search/DocSlice.java (at line 145)
 [ecj-lint] 	HashDocSet h = new HashDocSet(docs,offset,len);
 [ecj-lint] 	           ^
 [ecj-lint] Resource leak: 'h' is never closed
 [ecj-lint] ----------
 [ecj-lint] 14. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/search/DocSlice.java (at line 154)
 [ecj-lint] 	HashDocSet h = new HashDocSet(docs,offset,len);
 [ecj-lint] 	           ^
 [ecj-lint] Resource leak: 'h' is never closed
 [ecj-lint] ----------
 [ecj-lint] 15. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/search/DocSlice.java (at line 163)
 [ecj-lint] 	HashDocSet h = new HashDocSet(docs,offset,len);
 [ecj-lint] 	           ^
 [ecj-lint] Resource leak: 'h' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 16. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/search/function/OrdFieldSource.java (at line 79)
 [ecj-lint] 	SolrIndexSearcher is = (SolrIndexSearcher) o;
 [ecj-lint] 	                  ^^
 [ecj-lint] Resource leak: 'is' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 17. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/search/function/ReverseOrdFieldSource.java (at line 79)
 [ecj-lint] 	SolrIndexSearcher is = (SolrIndexSearcher) o;
 [ecj-lint] 	                  ^^
 [ecj-lint] Resource leak: 'is' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 18. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/servlet/SolrDispatchFilter.java (at line 291)
 [ecj-lint] 	throw new SolrException(ErrorCode.SERVER_ERROR, "Error occurred while loading solr.xml from zookeeper", e);
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'loader' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 19. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/CdcrTransactionLog.java (at line 98)
 [ecj-lint] 	ChannelFastInputStream is = new ChannelFastInputStream(channel, pos);
 [ecj-lint] 	                       ^^
 [ecj-lint] Resource leak: 'is' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 20. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/HdfsTransactionLog.java (at line 191)
 [ecj-lint] 	LogCodec codec = new LogCodec(resolver);
 [ecj-lint] 	         ^^^^^
 [ecj-lint] Resource leak: 'codec' is never closed
 [ecj-lint] ----------
 [ecj-lint] 21. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/HdfsTransactionLog.java (at line 261)
 [ecj-lint] 	LogCodec codec = new LogCodec(resolver);
 [ecj-lint] 	         ^^^^^
 [ecj-lint] Resource leak: 'codec' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 22. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/TransactionLog.java (at line 228)
 [ecj-lint] 	ChannelFastInputStream is = new ChannelFastInputStream(channel, pos);
 [ecj-lint] 	                       ^^
 [ecj-lint] Resource leak: 'is' is never closed
 [ecj-lint] ----------
 [ecj-lint] 23. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/TransactionLog.java (at line 228)
 [ecj-lint] 	ChannelFastInputStream is = new ChannelFastInputStream(channel, pos);
 [ecj-lint] 	                       ^^
 [ecj-lint] Resource leak: 'is' is never closed
 [ecj-lint] ----------
 [ecj-lint] 24. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/TransactionLog.java (at line 260)
 [ecj-lint] 	LogCodec codec = new LogCodec(resolver);
 [ecj-lint] 	         ^^^^^
 [ecj-lint] Resource leak: 'codec' is never closed
 [ecj-lint] ----------
 [ecj-lint] 25. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/TransactionLog.java (at line 275)
 [ecj-lint] 	LogCodec codec = new LogCodec(resolver);
 [ecj-lint] 	         ^^^^^
 [ecj-lint] Resource leak: 'codec' is never closed
 [ecj-lint] ----------
 [ecj-lint] 26. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/TransactionLog.java (at line 529)
 [ecj-lint] 	LogCodec codec = new LogCodec(resolver);
 [ecj-lint] 	         ^^^^^
 [ecj-lint] Resource leak: 'codec' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 27. ERROR in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/processor/DistributedUpdateProcessor.java (at line 372)
 [ecj-lint] 	/** For {@link CollectionParams.CollectionAction#SPLITSHARD} */
 [ecj-lint] 	               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Javadoc: Invalid member type qualification
 [ecj-lint] ----------
 [ecj-lint] 28. ERROR in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/processor/DistributedUpdateProcessor.java (at line 381)
 [ecj-lint] 	/** For {@link CollectionParams.CollectionAction#SPLITSHARD} */
 [ecj-lint] 	               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Javadoc: Invalid member type qualification
 [ecj-lint] ----------
 [ecj-lint] 29. ERROR in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/processor/DistributedUpdateProcessor.java (at line 406)
 [ecj-lint] 	/** For {@link CollectionParams.CollectionAction#SPLITSHARD} */
 [ecj-lint] 	               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Javadoc: Invalid member type qualification
 [ecj-lint] ----------
 [ecj-lint] 30. ERROR in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/update/processor/DistributedUpdateProcessor.java (at line 432)
 [ecj-lint] 	/** For {@link CollectionParams.CollectionAction#MIGRATE} */
 [ecj-lint] 	               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Javadoc: Invalid member type qualification
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 31. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/util/SimplePostTool.java (at line 655)
 [ecj-lint] 	BAOS bos =  new BAOS();
 [ecj-lint] 	     ^^^
 [ecj-lint] Resource leak: 'bos' is never closed
 [ecj-lint] ----------
 [ecj-lint] 32. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/util/SimplePostTool.java (at line 655)
 [ecj-lint] 	BAOS bos =  new BAOS();
 [ecj-lint] 	     ^^^
 [ecj-lint] Resource leak: 'bos' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 33. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/java/org/apache/solr/util/SolrLogLayout.java (at line 149)
 [ecj-lint] 	SolrQueryRequest req = requestInfo == null ? null : requestInfo.getReq();
 [ecj-lint] 	                 ^^^
 [ecj-lint] Resource leak: 'req' is never closed
 [ecj-lint] ----------
 [ecj-lint] 33 problems (4 errors, 29 warnings)

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:826: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:101: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build.xml:684: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:2087: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:2126: Compile failed; see the compiler error output for details.

Total time: 78 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.1) - Build # 20797 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20797/
Java: 64bit/jdk-9.0.1 -XX:-UseCompressedOops -XX:+UseG1GC --illegal-access=deny

2 tests failed.
FAILED:  org.apache.solr.cloud.TestCollectionAPI.test

Error Message:
Timeout occured while waiting response from server at: https://127.0.0.1:35985

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:35985
	at __randomizedtesting.SeedInfo.seed([3BD18F2CC432FDAD:B385B0F66ACE9055]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:315)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.base/java.net.SocketInputStream.socketRead0(Native Method)
	at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:425)
	at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:65)
	at java.base/sun.security.ssl.SSLSocketImpl.bytesInCompletePacket(SSLSocketImpl.java:918)
	at java.base/sun.security.ssl.AppInputStream.read(AppInputStream.java:144)
	at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
	at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
	at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 42 more


FAILED:  org.apache.solr.handler.TestSolrConfigHandlerCloud.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:39155/kt_/pj

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:39155/kt_/pj
	at __randomizedtesting.SeedInfo.seed([3BD18F2CC432FDAD:B385B0F66ACE9055]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:315)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.base/java.net.SocketInputStream.socketRead0(Native Method)
	at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
	at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
	at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 42 more




Build Log:
[...truncated 12443 lines...]
   [junit4] Suite: org.apache.solr.handler.TestSolrConfigHandlerCloud
   [junit4]   2> 468319 INFO  (SUITE-TestSolrConfigHandlerCloud-seed#[3BD18F2CC432FDAD]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestSolrConfigHandlerCloud_3BD18F2CC432FDAD-001/init-core-data-001
   [junit4]   2> 468319 INFO  (SUITE-TestSolrConfigHandlerCloud-seed#[3BD18F2CC432FDAD]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 468319 INFO  (SUITE-TestSolrConfigHandlerCloud-seed#[3BD18F2CC432FDAD]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 468319 INFO  (SUITE-TestSolrConfigHandlerCloud-seed#[3BD18F2CC432FDAD]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /kt_/pj
   [junit4]   2> 468320 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 468320 INFO  (Thread-1477) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 468320 INFO  (Thread-1477) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 468322 ERROR (Thread-1477) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 468420 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.ZkTestServer start zk server on port:44441
   [junit4]   2> 468440 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 468441 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 468442 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 468442 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 468443 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 468443 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 468444 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 468444 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 468444 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 468445 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 468445 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 468445 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 468558 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 468564 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@494fa24a{/kt_/pj,null,AVAILABLE}
   [junit4]   2> 468569 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@56fa7233{HTTP/1.1,[http/1.1]}{127.0.0.1:39155}
   [junit4]   2> 468569 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.e.j.s.Server Started @470040ms
   [junit4]   2> 468569 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/kt_/pj, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestSolrConfigHandlerCloud_3BD18F2CC432FDAD-001/tempDir-001/control/data, hostPort=39155, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestSolrConfigHandlerCloud_3BD18F2CC432FDAD-001/control-001/cores}
   [junit4]   2> 468569 ERROR (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 468569 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 468569 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 468569 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 468569 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T16:58:51.440894Z
   [junit4]   2> 468574 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 468574 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestSolrConfigHandlerCloud_3BD18F2CC432FDAD-001/control-001/solr.xml
   [junit4]   2> 468576 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 468576 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 468576 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@52aa8dfd, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 468578 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44441/solr
   [junit4]   2> 468618 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 468619 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39155_kt_%2Fpj
   [junit4]   2> 468619 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.Overseer Overseer (id=98930231292198916-127.0.0.1:39155_kt_%2Fpj-n_0000000000) starting
   [junit4]   2> 468623 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39155_kt_%2Fpj
   [junit4]   2> 468624 INFO  (OverseerStateUpdate-98930231292198916-127.0.0.1:39155_kt_%2Fpj-n_0000000000) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 468669 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@52aa8dfd
   [junit4]   2> 468674 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@52aa8dfd
   [junit4]   2> 468674 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@52aa8dfd
   [junit4]   2> 468675 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestSolrConfigHandlerCloud_3BD18F2CC432FDAD-001/control-001/cores
   [junit4]   2> 468685 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 468685 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44441/solr ready
   [junit4]   2> 468687 INFO  (qtp1953797862-3877) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:39155_kt_%252Fpj&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 468688 INFO  (OverseerThreadFactory-1371-thread-1-processing-n:127.0.0.1:39155_kt_%2Fpj) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 468791 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 468792 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 468894 INFO  (zkCallback-558-thread-1-processing-n:127.0.0.1:39155_kt_%2Fpj) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 469807 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 469827 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 469969 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 469983 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 469983 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@52aa8dfd
   [junit4]   2> 469984 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 469984 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestSolrConfigHandlerCloud_3BD18F2CC432FDAD-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestSolrConfigHandlerCloud_3BD18F2CC432FDAD-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 469985 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=83.8857421875, floorSegmentMB=1.0361328125, forceMergeDeletesPctAllowed=5.9325856326270685, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 469987 WARN  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 470012 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 470013 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 470014 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 470014 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 470015 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=46, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 470016 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@62ffb8e4[control_collection_shard1_replica_n1] main]
   [junit4]   2> 470021 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 470021 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 470022 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 470022 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582883702458810368
   [junit4]   2> 470023 INFO  (searcherExecutor-1374-thread-1-processing-n:127.0.0.1:39155_kt_%2Fpj x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@62ffb8e4[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 470024 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 470024 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 470024 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:39155/kt_/pj/control_collection_shard1_replica_n1/
   [junit4]   2> 470024 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 470024 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:39155/kt_/pj/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 470024 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 470025 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:39155/kt_/pj/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 528743 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.ChaosMonkey monkey: stop jetty! 39155
   [junit4]   2> 528743 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=907649986
   [junit4]   2> 528743 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 528743 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6a17074f: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@55a33156
   [junit4]   2> 528748 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 528749 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7fcfb8cc: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3b23dec2
   [junit4]   2> 528753 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 528753 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@28f4bd6f: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5789df50
   [junit4]   2> 528755 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:39155_kt_%2Fpj
   [junit4]   2> 528756 INFO  (zkCallback-558-thread-2-processing-n:127.0.0.1:39155_kt_%2Fpj) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 528756 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 528757 INFO  (coreCloseExecutor-1379-thread-1) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@75c946c
   [junit4]   2> 528757 INFO  (coreCloseExecutor-1379-thread-1) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.control_collection.shard1.replica_n1, tag=123507820
   [junit4]   2> 528757 INFO  (coreCloseExecutor-1379-thread-1) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@67339e3c: rootName = null, domain = solr.core.control_collection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.control_collection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@544fe857
   [junit4]   2> 528765 INFO  (coreCloseExecutor-1379-thread-1) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.control_collection.shard1.leader, tag=123507820
   [junit4]   2> 539668 INFO  (ScheduledTrigger-1369-thread-1) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 539693 INFO  (AutoscalingActionExecutor-1370-thread-1-processing-n:127.0.0.1:39155_kt_%2Fpj) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.a.ExecutePlanAction No operations to execute for event: {
   [junit4]   2>   "id":"14f304d03d09a8c0T4f1g657rqqdgrg9mk9h2ci4sv",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":1509555592523000000,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1509555592523000000],
   [junit4]   2>     "_enqueue_time_":1509555602538000000,
   [junit4]   2>     "nodeNames":["127.0.0.1:39155_kt_%2Fpj"]}}
   [junit4]   2> 648688 ERROR (qtp1953797862-3877) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: create the collection time out:180s
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 648690 INFO  (qtp1953797862-3877) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:39155_kt_%252Fpj&wt=javabin&version=2} status=500 QTime=180003
   [junit4]   2> 648690 ERROR (qtp1953797862-3877) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: create the collection time out:180s
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 1068889 ERROR (OverseerThreadFactory-1371-thread-1-processing-n:127.0.0.1:39155_kt_%2Fpj) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:39155/kt_/pj
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:39155/kt_/pj
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: java.net.SocketTimeoutException: Read timed out
   [junit4]   2> 	at java.base/java.net.SocketInputStream.socketRead0(Native Method)
   [junit4]   2> 	at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   [junit4]   2> 	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:171)
   [junit4]   2> 	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:141)
   [junit4]   2> 	at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
   [junit4]   2> 	at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
   [junit4]   2> 	at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 1068889 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.Overseer Overseer (id=98930231292198916-127.0.0.1:39155_kt_%2Fpj-n_0000000000) closing
   [junit4]   2> 1068890 ERROR (OverseerThreadFactory-1371-thread-1-processing-n:127.0.0.1:39155_kt_%2Fpj) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [control_collection].
   [junit4]   2> 1068890 INFO  (OverseerStateUpdate-98930231292198916-127.0.0.1:39155_kt_%2Fpj-n_0000000000) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:39155_kt_%2Fpj
   [junit4]   2> 1068891 INFO  (OverseerThreadFactory-1371-thread-1-processing-n:127.0.0.1:39155_kt_%2Fpj) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 1098927 INFO  (zkCallback-558-thread-5-processing-n:127.0.0.1:39155_kt_%2Fpj) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1098928 ERROR (OverseerThreadFactory-1371-thread-1-processing-n:127.0.0.1:39155_kt_%2Fpj) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.OverseerCollectionMessageHandler Collection: control_collection operation: create failed:org.apache.solr.common.SolrException: Could not fully remove collection: control_collection
   [junit4]   2> 	at org.apache.solr.cloud.DeleteCollectionCmd.call(DeleteCollectionCmd.java:109)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.cleanupCollection(OverseerCollectionMessageHandler.java:678)
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:302)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 1098928 INFO  (OverseerThreadFactory-1371-thread-1-processing-n:127.0.0.1:39155_kt_%2Fpj) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1098928 WARN  (OverseerAutoScalingTriggerThread-98930231292198916-127.0.0.1:39155_kt_%2Fpj-n_0000000000) [n:127.0.0.1:39155_kt_%2Fpj    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1098930 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@56fa7233{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1098930 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@494fa24a{/kt_/pj,null,UNAVAILABLE}
   [junit4]   2> 1098977 ERROR (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController Error getting leader from zk
   [junit4]   2> org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: control_collection slice: shard1 saw state=null with live_nodes=[]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:816)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:781)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:890)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1050)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1098978 ERROR (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkContainer :org.apache.solr.common.SolrException: Error getting leader from zk for shard shard1
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1207)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:890)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1050)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: control_collection slice: shard1 saw state=null with live_nodes=[]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:816)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:781)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
   [junit4]   2> 	... 41 more
   [junit4]   2> 
   [junit4]   2> 1098978 INFO  (qtp1953797862-3880) [n:127.0.0.1:39155_kt_%2Fpj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=630186
   [junit4]   2> 1098979 ERROR (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1098979 INFO  (TEST-TestSolrConfigHandlerCloud.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44441 44441
   [junit4]   2> 1104040 INFO  (Thread-1477) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44441 44441
   [junit4]   2> 1104040 WARN  (Thread-1477) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/live_nodes
   [junit4]   2> 	2	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrConfigHandlerCloud -Dtests.method=test -Dtests.seed=3BD18F2CC432FDAD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr-CS -Dtests.timezone=Pacific/Chatham -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR    636s J1 | TestSolrConfigHandlerCloud.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:39155/kt_/pj
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3BD18F2CC432FDAD:B385B0F66ACE9055]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:315)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]    > Caused by: java.net.SocketTimeoutException: Read timed out
   [junit4]    > 	at java.base/java.net.SocketInputStream.socketRead0(Native Method)
   [junit4]    > 	at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   [junit4]    > 	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:171)
   [junit4]    > 	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:141)
   [junit4]    > 	at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
   [junit4]    > 	at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
   [junit4]    > 	at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]    > 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]    > 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]    > 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]    > 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]    > 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]    > 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]    > 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]    > 	... 42 more
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestSolrConfigHandlerCloud_3BD18F2CC432FDAD-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=995, maxMBSortInHeap=6.390162638448821, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1560e674), locale=sr-CS, timezone=Pacific/Chatham
   [junit4]   2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=1,free=269313616,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [QueryResultKeyTest, UpdateLogTest, TestLockTree, BadIndexSchemaTest, SecurityConfHandlerTest, DeleteLastCustomShardedReplicaTest, NumericFieldsTest, SearchRateTriggerTest, SolrCmdDistributorTest, TestAnalyzedSuggestions, MBeansHandlerTest, TestSubQueryTransformerCrossCore, TestSolr4Spatial, TestMinMaxOnMultiValuedField, TestBulkSchemaConcurrent, StressHdfsTest, QueryEqualityTest, CollectionTooManyReplicasTest, SuggestComponentTest, TestHdfsBackupRestoreCore, SignatureUpdateProcessorFactoryTest, ConvertedLegacyTest, DistributedIntervalFacetingTest, TestPerFieldSimilarityWithDefaultOverride, TestCloudRecovery, TestXIncludeConfig, TriggerIntegrationTest, ClassificationUpdateProcessorIntegrationTest, TestCloudJSONFacetJoinDomain, DistributedTermsComponentTest, CachingDirectoryFactoryTest, TestSolrConfigHandlerCloud]
   [junit4] Completed [267/747 (1!)] on J1 in 635.73s, 1 test, 1 error <<< FAILURES!

[...truncated 1398 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestCollectionAPI
   [junit4]   2> 2705131 INFO  (SUITE-TestCollectionAPI-seed#[3BD18F2CC432FDAD]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCollectionAPI_3BD18F2CC432FDAD-001/init-core-data-001
   [junit4]   2> 2705131 INFO  (SUITE-TestCollectionAPI-seed#[3BD18F2CC432FDAD]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2705133 INFO  (SUITE-TestCollectionAPI-seed#[3BD18F2CC432FDAD]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 2705133 INFO  (SUITE-TestCollectionAPI-seed#[3BD18F2CC432FDAD]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 2705135 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2705136 INFO  (Thread-4042) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2705136 INFO  (Thread-4042) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2705137 ERROR (Thread-4042) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2705236 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.ZkTestServer start zk server on port:35597
   [junit4]   2> 2705246 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2705247 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 2705248 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2705249 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2705250 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2705252 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2705252 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2705253 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2705254 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2705255 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2705255 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2705258 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 2705396 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2705397 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@428513e7{/,null,AVAILABLE}
   [junit4]   2> 2705398 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@265ec51{SSL,[ssl, http/1.1]}{127.0.0.1:35985}
   [junit4]   2> 2705398 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.e.j.s.Server Started @2707287ms
   [junit4]   2> 2705398 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCollectionAPI_3BD18F2CC432FDAD-001/tempDir-001/control/data, hostPort=35985, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCollectionAPI_3BD18F2CC432FDAD-001/control-001/cores}
   [junit4]   2> 2705398 ERROR (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2705398 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2705398 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2705398 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2705398 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T17:36:08.691897Z
   [junit4]   2> 2705400 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2705400 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCollectionAPI_3BD18F2CC432FDAD-001/control-001/solr.xml
   [junit4]   2> 2705401 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 2705402 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2705402 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7243967a, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2705404 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35597/solr
   [junit4]   2> 2705427 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:35985_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2705427 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:35985_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35985_
   [junit4]   2> 2705428 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:35985_    ] o.a.s.c.Overseer Overseer (id=98930377911828485-127.0.0.1:35985_-n_0000000000) starting
   [junit4]   2> 2705430 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:35985_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35985_
   [junit4]   2> 2705430 INFO  (zkCallback-4833-thread-1-processing-n:127.0.0.1:35985_) [n:127.0.0.1:35985_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2705456 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:35985_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7243967a
   [junit4]   2> 2705462 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:35985_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7243967a
   [junit4]   2> 2705462 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:35985_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7243967a
   [junit4]   2> 2705463 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [n:127.0.0.1:35985_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCollectionAPI_3BD18F2CC432FDAD-001/control-001/cores
   [junit4]   2> 2705471 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2705471 INFO  (TEST-TestCollectionAPI.test-seed#[3BD18F2CC432FDAD]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35597/solr ready
   [junit4]   2> 2705480 INFO  (qtp260607740-29065) [n:127.0.0.1:35985_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35985_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2705482 INFO  (OverseerThreadFactory-6376-thread-1-processing-n:127.0.0.1:35985_) [n:127.0.0.1:35985_    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 2705590 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2705591 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2705694 INFO  (zkCallback-4833-thread-1-processing-n:127.0.0.1:35985_) [n:127.0.0.1:35985_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2706612 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2706626 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 2706718 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2706725 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 2706725 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7243967a
   [junit4]   2> 2706725 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2706725 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCollectionAPI_3BD18F2CC432FDAD-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCollectionAPI_3BD18F2CC432FDAD-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 2706727 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.13962672388948258]
   [junit4]   2> 2706729 WARN  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2706758 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2706759 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2706760 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2706760 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2706760 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=31.75390625, floorSegmentMB=1.0322265625, forceMergeDeletesPctAllowed=27.077329235057796, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6960626399223954
   [junit4]   2> 2706760 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7cc1e0b2[control_collection_shard1_replica_n1] main]
   [junit4]   2> 2706761 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2706761 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2706762 INFO  (qtp260607740-29066) [n:127.0.0.1:35985_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2706762 INFO  (searcherExecutor-6379-thread-1-processing-n:127.0.0.1:35985_ x:control_collection_shard1_rep

[...truncated too long message...]

concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/live_nodes
   [junit4]   2> 	2	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCollectionAPI -Dtests.method=test -Dtests.seed=3BD18F2CC432FDAD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=twq-NE -Dtests.timezone=US/Pacific -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR    636s J2 | TestCollectionAPI.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:35985
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3BD18F2CC432FDAD:B385B0F66ACE9055]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:315)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]    > Caused by: java.net.SocketTimeoutException: Read timed out
   [junit4]    > 	at java.base/java.net.SocketInputStream.socketRead0(Native Method)
   [junit4]    > 	at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   [junit4]    > 	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:171)
   [junit4]    > 	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:141)
   [junit4]    > 	at java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:425)
   [junit4]    > 	at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:65)
   [junit4]    > 	at java.base/sun.security.ssl.SSLSocketImpl.bytesInCompletePacket(SSLSocketImpl.java:918)
   [junit4]    > 	at java.base/sun.security.ssl.AppInputStream.read(AppInputStream.java:144)
   [junit4]    > 	at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
   [junit4]    > 	at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
   [junit4]    > 	at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]    > 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]    > 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]    > 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]    > 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]    > 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]    > 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]    > 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]    > 	... 42 more
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCollectionAPI_3BD18F2CC432FDAD-001
   [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=8, maxDocsPerChunk=5, blockSize=718), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=8, blockSize=718)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@490a689d), locale=twq-NE, timezone=US/Pacific
   [junit4]   2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=1,free=107125512,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestManagedSchemaThreadSafety, BlobRepositoryCloudTest, TestLMDirichletSimilarityFactory, TestCharFilters, StatsComponentTest, MigrateRouteKeyTest, TestCloudManagedSchema, TestSolrCloudWithHadoopAuthPlugin, CdcrVersionReplicationTest, DefaultValueUpdateProcessorTest, DistributedDebugComponentTest, TestAuthorizationFramework, SpatialHeatmapFacetsTest, CustomCollectionTest, TestQueryTypes, TestMaxScoreQueryParser, TestZkChroot, TestSha256AuthenticationProvider, TestManagedStopFilterFactory, UtilsToolTest, TestRandomRequestDistribution, TestFuzzyAnalyzedSuggestions, OverseerStatusTest, TestBlobHandler, NodeAddedTriggerTest, ZkNodePropsTest, TestNoOpRegenerator, TestFunctionQuery, TestCollectionsAPIViaSolrCloudCluster, TestDynamicFieldCollectionResource, TestEmbeddedSolrServerConstructors, TestCloudDeleteByQuery, TestSystemIdResolver, NodeMutatorTest, TestCSVResponseWriter, TestHdfsCloudBackupRestore, HdfsChaosMonkeySafeLeaderTest, CollectionsAPIAsyncDistributedZkTest, TestSolrFieldCacheBean, TestSearchPerf, SortByFunctionTest, TestComplexPhraseLeadingWildcard, TestCoreContainer, MoveReplicaHDFSTest, SuggesterTest, TestSolrCloudWithSecureImpersonation, GraphQueryTest, TestTrie, TestReloadDeadlock, TestReplicationHandlerBackup, UniqFieldsUpdateProcessorFactoryTest, DocValuesNotIndexedTest, SSLMigrationTest, TestRTimerTree, SegmentsInfoRequestHandlerTest, TestStressLiveNodes, TestRawTransformer, TestAnalyzeInfixSuggestions, TestReload, HdfsLockFactoryTest, HighlighterMaxOffsetTest, NumberUtilsTest, TestValueSourceCache, ClassificationUpdateProcessorTest, TestNumericTerms32, TestCloudPivotFacet, SolrMetricManagerTest, FullHLLTest, TestCollectionAPIs, ScriptEngineTest, AnalyticsMergeStrategyTest, BlockDirectoryTest, LeaderElectionTest, TestCustomStream, VMParamsZkACLAndCredentialsProvidersTest, UninvertDocValuesMergePolicyTest, TestSolrConfigHandlerConcurrent, TestHashPartitioner, DirectSolrSpellCheckerTest, TestSmileRequest, TestSolrCoreSnapshots, TestSubQueryTransformerDistrib, TestIndexSearcher, TestTolerantUpdateProcessorRandomCloud, TestFieldCacheVsDocValues, SolrJmxReporterTest, EnumFieldTest, TestGroupingSearch, TestQuerySenderListener, TestPayloadScoreQParserPlugin, DeleteNodeTest, SolrTestCaseJ4Test, PluginInfoTest, CoreAdminRequestStatusTest, CoreAdminHandlerTest, TestClusterStateMutator, TestHashQParserPlugin, TestLRUCache, OverseerTest, TestTolerantSearch, TestSchemalessBufferedUpdates, WordBreakSolrSpellCheckerTest, CopyFieldTest, AliasIntegrationTest, TestLMJelinekMercerSimilarityFactory, ConnectionReuseTest, TestDFISimilarityFactory, BadComponentTest, TestSolrCoreProperties, XmlUpdateRequestHandlerTest, TestHalfAndHalfDocValues, BasicDistributedZk2Test, AsyncCallRequestStatusResponseTest, FieldAnalysisRequestHandlerTest, TimeZoneUtilsTest, TestSegmentSorting, ConfigSetsAPITest, TestRealTimeGet, TestPivotHelperCode, BasicDistributedZkTest, PreAnalyzedFieldTest, PrimUtilsTest, DateFieldTest, SpellingQueryConverterTest, DOMUtilTest, ClusterStateTest, TestSolrJ, TestUtils, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, TestCrossCoreJoin, TestDistributedMissingSort, TestHighlightDedupGrouping, TestEmbeddedSolrServerSchemaAPI, ActionThrottleTest, AddReplicaTest, BaseCdcrDistributedZkTest, CdcrReplicationDistributedZkTest, CdcrRequestHandlerTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, ConnectionManagerTest, CreateCollectionCleanupTest, DeleteStatusTest, DistributedQueueTest, LeaderFailureAfterFreshStartTest, LeaderInitiatedRecoveryOnShardRestartTest, MissingSegmentRecoveryTest, MoveReplicaHDFSFailoverTest, OverseerCollectionConfigSetProcessorTest, OverseerRolesTest, PeerSyncReplicationTest, ReplicationFactorTest, RestartWhileUpdatingTest, RollingRestartTest, TestClusterProperties, TestCollectionAPI]
   [junit4] Completed [667/747 (2!)] on J2 in 635.71s, 1 test, 1 error <<< FAILURES!

[...truncated 40328 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20796 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20796/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.cloud.CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster

Error Message:
Error from server at https://127.0.0.1:34085/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:34085/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([7E317C251EB1DB63:AA74377CF9E76898]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.cloud.CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster(CdcrBootstrapTest.java:267)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple

Error Message:
Timeout waiting for all live and active

Stack Trace:
java.lang.AssertionError: Timeout waiting for all live and active
	at __randomizedtesting.SeedInfo.seed([7E317C251EB1DB63:468258DB39420FB2]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:91)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12340 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/init-core-data-001
   [junit4]   2> 675449 WARN  (SUITE-AutoAddReplicasIntegrationTest-seed#[7E317C251EB1DB63]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=128 numCloses=128
   [junit4]   2> 675450 INFO  (SUITE-AutoAddReplicasIntegrationTest-seed#[7E317C251EB1DB63]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 675451 INFO  (SUITE-AutoAddReplicasIntegrationTest-seed#[7E317C251EB1DB63]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 675451 INFO  (SUITE-AutoAddReplicasIntegrationTest-seed#[7E317C251EB1DB63]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 675452 INFO  (SUITE-AutoAddReplicasIntegrationTest-seed#[7E317C251EB1DB63]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001
   [junit4]   2> 675452 INFO  (SUITE-AutoAddReplicasIntegrationTest-seed#[7E317C251EB1DB63]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 675452 INFO  (Thread-2428) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 675452 INFO  (Thread-2428) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 675463 ERROR (Thread-2428) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 675552 INFO  (SUITE-AutoAddReplicasIntegrationTest-seed#[7E317C251EB1DB63]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:42263
   [junit4]   2> 675557 INFO  (jetty-launcher-952-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 675557 INFO  (jetty-launcher-952-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 675557 INFO  (jetty-launcher-952-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 675558 INFO  (jetty-launcher-952-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5d0659b{/solr,null,AVAILABLE}
   [junit4]   2> 675559 INFO  (jetty-launcher-952-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5752de57{SSL,[ssl, http/1.1]}{127.0.0.1:33797}
   [junit4]   2> 675559 INFO  (jetty-launcher-952-thread-2) [    ] o.e.j.s.Server Started @677746ms
   [junit4]   2> 675559 INFO  (jetty-launcher-952-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33797}
   [junit4]   2> 675559 ERROR (jetty-launcher-952-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 675560 INFO  (jetty-launcher-952-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 675560 INFO  (jetty-launcher-952-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 675560 INFO  (jetty-launcher-952-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 675560 INFO  (jetty-launcher-952-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T14:01:59.814Z
   [junit4]   2> 675561 INFO  (jetty-launcher-952-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 675563 INFO  (jetty-launcher-952-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4f15cc94{/solr,null,AVAILABLE}
   [junit4]   2> 675567 INFO  (jetty-launcher-952-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@34c80ce6{SSL,[ssl, http/1.1]}{127.0.0.1:39715}
   [junit4]   2> 675567 INFO  (jetty-launcher-952-thread-1) [    ] o.e.j.s.Server Started @677754ms
   [junit4]   2> 675567 INFO  (jetty-launcher-952-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39715}
   [junit4]   2> 675572 INFO  (jetty-launcher-952-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@44930d91{/solr,null,AVAILABLE}
   [junit4]   2> 675572 ERROR (jetty-launcher-952-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 675572 INFO  (jetty-launcher-952-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 675572 INFO  (jetty-launcher-952-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 675572 INFO  (jetty-launcher-952-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 675572 INFO  (jetty-launcher-952-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T14:01:59.826Z
   [junit4]   2> 675573 INFO  (jetty-launcher-952-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@698f5d1e{SSL,[ssl, http/1.1]}{127.0.0.1:38135}
   [junit4]   2> 675573 INFO  (jetty-launcher-952-thread-3) [    ] o.e.j.s.Server Started @677759ms
   [junit4]   2> 675573 INFO  (jetty-launcher-952-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38135}
   [junit4]   2> 675573 ERROR (jetty-launcher-952-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 675573 INFO  (jetty-launcher-952-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 675573 INFO  (jetty-launcher-952-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 675573 INFO  (jetty-launcher-952-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 675573 INFO  (jetty-launcher-952-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T14:01:59.827Z
   [junit4]   2> 675575 INFO  (jetty-launcher-952-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 675575 INFO  (jetty-launcher-952-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42263/solr
   [junit4]   2> 675575 INFO  (jetty-launcher-952-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 675580 INFO  (jetty-launcher-952-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42263/solr
   [junit4]   2> 675581 INFO  (jetty-launcher-952-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42263/solr
   [junit4]   2> 675589 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f77e3829c0005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 675594 INFO  (jetty-launcher-952-thread-2) [n:127.0.0.1:33797_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 675594 INFO  (jetty-launcher-952-thread-1) [n:127.0.0.1:39715_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 675595 INFO  (jetty-launcher-952-thread-2) [n:127.0.0.1:33797_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33797_solr
   [junit4]   2> 675595 INFO  (jetty-launcher-952-thread-2) [n:127.0.0.1:33797_solr    ] o.a.s.c.Overseer Overseer (id=98929535857983496-127.0.0.1:33797_solr-n_0000000000) starting
   [junit4]   2> 675595 INFO  (jetty-launcher-952-thread-1) [n:127.0.0.1:39715_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39715_solr
   [junit4]   2> 675600 INFO  (zkCallback-970-thread-1-processing-n:127.0.0.1:39715_solr) [n:127.0.0.1:39715_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 675600 INFO  (zkCallback-961-thread-1-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 675604 DEBUG (OverseerAutoScalingTriggerThread-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 675604 INFO  (jetty-launcher-952-thread-2) [n:127.0.0.1:33797_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33797_solr
   [junit4]   2> 675604 DEBUG (OverseerAutoScalingTriggerThread-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 675612 INFO  (zkCallback-961-thread-1-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 675612 INFO  (zkCallback-970-thread-1-processing-n:127.0.0.1:39715_solr) [n:127.0.0.1:39715_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 675612 DEBUG (OverseerAutoScalingTriggerThread-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:39715_solr, 127.0.0.1:33797_solr]
   [junit4]   2> 675612 DEBUG (OverseerAutoScalingTriggerThread-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 675612 DEBUG (OverseerAutoScalingTriggerThread-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 675633 DEBUG (OverseerAutoScalingTriggerThread-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 675633 DEBUG (OverseerAutoScalingTriggerThread-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 675633 DEBUG (ScheduledTrigger-2385-thread-1) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:39715_solr, 127.0.0.1:33797_solr]
   [junit4]   2> 675646 INFO  (jetty-launcher-952-thread-3) [n:127.0.0.1:38135_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 675647 INFO  (jetty-launcher-952-thread-3) [n:127.0.0.1:38135_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 675647 INFO  (jetty-launcher-952-thread-3) [n:127.0.0.1:38135_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38135_solr
   [junit4]   2> 675648 INFO  (zkCallback-961-thread-1-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 675648 INFO  (zkCallback-970-thread-1-processing-n:127.0.0.1:39715_solr) [n:127.0.0.1:39715_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 675654 INFO  (zkCallback-968-thread-1-processing-n:127.0.0.1:38135_solr) [n:127.0.0.1:38135_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 675667 INFO  (jetty-launcher-952-thread-1) [n:127.0.0.1:39715_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39715.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 675668 INFO  (jetty-launcher-952-thread-2) [n:127.0.0.1:33797_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33797.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 675688 INFO  (jetty-launcher-952-thread-1) [n:127.0.0.1:39715_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39715.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 675688 INFO  (jetty-launcher-952-thread-1) [n:127.0.0.1:39715_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39715.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 675688 INFO  (jetty-launcher-952-thread-2) [n:127.0.0.1:33797_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33797.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 675688 INFO  (jetty-launcher-952-thread-2) [n:127.0.0.1:33797_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33797.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 675689 INFO  (jetty-launcher-952-thread-1) [n:127.0.0.1:39715_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node1/.
   [junit4]   2> 675689 INFO  (jetty-launcher-952-thread-2) [n:127.0.0.1:33797_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node2/.
   [junit4]   2> 675752 INFO  (jetty-launcher-952-thread-3) [n:127.0.0.1:38135_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38135.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 675760 INFO  (jetty-launcher-952-thread-3) [n:127.0.0.1:38135_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38135.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 675760 INFO  (jetty-launcher-952-thread-3) [n:127.0.0.1:38135_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38135.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 675761 INFO  (jetty-launcher-952-thread-3) [n:127.0.0.1:38135_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node3/.
   [junit4]   2> 675781 INFO  (SUITE-AutoAddReplicasIntegrationTest-seed#[7E317C251EB1DB63]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 675782 INFO  (SUITE-AutoAddReplicasIntegrationTest-seed#[7E317C251EB1DB63]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42263/solr ready
   [junit4]   2> 675803 INFO  (TEST-AutoAddReplicasIntegrationTest.testSimple-seed#[7E317C251EB1DB63]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSimple
   [junit4]   2> 675823 INFO  (qtp1116394022-7233) [n:127.0.0.1:39715_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:39715_solr,127.0.0.1:33797_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 675824 INFO  (OverseerThreadFactory-2387-thread-1-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.CreateCollectionCmd Create collection testSimple1
   [junit4]   2> 675928 INFO  (OverseerStateUpdate-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33797/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 675929 INFO  (OverseerStateUpdate-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple1_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39715/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 675930 INFO  (OverseerStateUpdate-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple1_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33797/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 675931 INFO  (OverseerStateUpdate-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple1_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39715/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 676143 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 676143 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 676144 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 676165 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 676166 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 676173 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 676275 INFO  (zkCallback-970-thread-1-processing-n:127.0.0.1:39715_solr) [n:127.0.0.1:39715_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 676275 INFO  (zkCallback-961-thread-1-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 676275 INFO  (zkCallback-961-thread-2-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 676634 DEBUG (ScheduledTrigger-2385-thread-1) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:39715_solr, 127.0.0.1:33797_solr, 127.0.0.1:38135_solr]
   [junit4]   2> 677152 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 677156 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 677157 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 677157 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n6' using configuration from collection testSimple1, trusted=true
   [junit4]   2> 677157 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39715.solr.core.testSimple1.shard2.replica_n6' (registry 'solr.core.testSimple1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 677157 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 677157 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node1/testSimple1_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node1/./testSimple1_shard2_replica_n6/data/]
   [junit4]   2> 677164 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 677182 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 677183 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 677184 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 677184 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n2' using configuration from collection testSimple1, trusted=true
   [junit4]   2> 677184 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 677184 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39715.solr.core.testSimple1.shard1.replica_n2' (registry 'solr.core.testSimple1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 677184 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 677184 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node1/testSimple1_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node1/./testSimple1_shard1_replica_n2/data/]
   [junit4]   2> 677188 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 677188 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 677190 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 677190 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n4' using configuration from collection testSimple1, trusted=true
   [junit4]   2> 677190 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 677190 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n1' using configuration from collection testSimple1, trusted=true
   [junit4]   2> 677190 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33797.solr.core.testSimple1.shard1.replica_n1' (registry 'solr.core.testSimple1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 677190 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33797.solr.core.testSimple1.shard2.replica_n4' (registry 'solr.core.testSimple1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 677190 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 677190 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 677190 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node2/testSimple1_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node2/./testSimple1_shard1_replica_n1/data/]
   [junit4]   2> 677190 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node2/testSimple1_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node2/./testSimple1_shard2_replica_n4/data/]
   [junit4]   2> 677207 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 677208 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 677209 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 677209 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 677210 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@7e5b646b[testSimple1_shard2_replica_n6] main]
   [junit4]   2> 677211 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 677211 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 677211 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 677212 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582872575571132416
   [junit4]   2> 677213 INFO  (searcherExecutor-2394-thread-1-processing-n:127.0.0.1:39715_solr x:testSimple1_shard2_replica_n6 s:shard2 c:testSimple1 r:core_node8) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [testSimple1_shard2_replica_n6] Registered new searcher Searcher@7e5b646b[testSimple1_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 677233 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 677236 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 677236 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 677237 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 677237 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 677238 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@149f091e[testSimple1_shard2_replica_n4] main]
   [junit4]   2> 677238 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 677238 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 677238 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 677238 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 677239 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 677239 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 677239 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 677239 INFO  (searcherExecutor-2396-thread-1-processing-n:127.0.0.1:33797_solr x:testSimple1_shard2_replica_n4 s:shard2 c:testSimple1 r:core_node7) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [testSimple1_shard2_replica_n4] Registered new searcher Searcher@149f091e[testSimple1_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 677239 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582872575599443968
   [junit4]   2> 677241 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@6d776030[testSimple1_shard1_replica_n2] main]
   [junit4]   2> 677244 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 677244 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 677244 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 677245 INFO  (searcherExecutor-2395-thread-1-processing-n:127.0.0.1:39715_solr x:testSimple1_shard1_replica_n2 s:shard1 c:testSimple1 r:core_node5) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [testSimple1_shard1_replica_n2] Registered new searcher Searcher@6d776030[testSimple1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 677245 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582872575605735424
   [junit4]   2> 677248 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 677250 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 677250 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 677251 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 677251 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 677252 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b894d3e[testSimple1_shard1_replica_n1] main]
   [junit4]   2> 677253 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 677253 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 677253 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 677254 INFO  (searcherExecutor-2397-thread-1-processing-n:127.0.0.1:33797_solr x:testSimple1_shard1_replica_n1 s:shard1 c:testSimple1 r:core_node3) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore [testSimple1_shard1_replica_n1] Registered new searcher Searcher@3b894d3e[testSimple1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 677254 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582872575615172608
   [junit4]   2> 677350 INFO  (zkCallback-961-thread-2-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 677350 INFO  (zkCallback-970-thread-1-processing-n:127.0.0.1:39715_solr) [n:127.0.0.1:39715_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 677350 INFO  (zkCallback-961-thread-1-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 677635 DEBUG (ScheduledTrigger-2385-thread-2) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:39715_solr, 127.0.0.1:33797_solr, 127.0.0.1:38135_solr]
   [junit4]   2> 677734 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 677734 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 677734 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:39715/solr/testSimple1_shard2_replica_n6/
   [junit4]   2> 677734 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n6 url=https://127.0.0.1:39715/solr START replicas=[https://127.0.0.1:33797/solr/testSimple1_shard2_replica_n4/] nUpdates=100
   [junit4]   2> 677737 INFO  (qtp1107326822-7242) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.S.Request [testSimple1_shard2_replica_n4]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 677749 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 677749 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 677749 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:39715/solr/testSimple1_shard1_replica_n2/
   [junit4]   2> 677749 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard1_replica_n2 url=https://127.0.0.1:39715/solr START replicas=[https://127.0.0.1:33797/solr/testSimple1_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 677750 INFO  (qtp1107326822-7238) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.S.Request [testSimple1_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 678034 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n6 url=https://127.0.0.1:39715/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 678035 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 678035 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 678035 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 678036 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:39715/solr/testSimple1_shard2_replica_n6/ shard2
   [junit4]   2> 678049 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard1_replica_n2 url=https://127.0.0.1:39715/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 678049 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 678049 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 678049 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 678051 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:39715/solr/testSimple1_shard1_replica_n2/ shard1
   [junit4]   2> 678152 INFO  (zkCallback-961-thread-1-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 678152 INFO  (zkCallback-961-thread-2-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 678152 INFO  (zkCallback-970-thread-1-processing-n:127.0.0.1:39715_solr) [n:127.0.0.1:39715_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 678187 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 678187 INFO  (qtp1116394022-7249) [n:127.0.0.1:39715_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2044
   [junit4]   2> 678201 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 678202 INFO  (qtp1116394022-7253) [n:127.0.0.1:39715_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2059
   [junit4]   2> 678248 INFO  (qtp1107326822-7237) [n:127.0.0.1:33797_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2082
   [junit4]   2> 678257 INFO  (qtp1107326822-7241) [n:127.0.0.1:33797_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2084
   [junit4]   2> 678259 INFO  (qtp1116394022-7233) [n:127.0.0.1:39715_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 678358 INFO  (zkCallback-970-thread-1-processing-n:127.0.0.1:39715_solr) [n:127.0.0.1:39715_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 678358 INFO  (zkCallback-961-thread-1-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 678358 INFO  (zkCallback-961-thread-2-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 678635 DEBUG (ScheduledTrigger-2385-thread-1) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:39715_solr, 127.0.0.1:33797_solr, 127.0.0.1:38135_solr]
   [junit4]   2> 679260 INFO  (qtp1116394022-7233) [n:127.0.0.1:39715_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:39715_solr,127.0.0.1:33797_solr&wt=javabin&version=2} status=0 QTime=3436
   [junit4]   2> 679260 INFO  (qtp1116394022-7252) [n:127.0.0.1:39715_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=false&name=testSimple2&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:33797_solr,127.0.0.1:38135_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 679261 INFO  (OverseerThreadFactory-2387-thread-2-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.CreateCollectionCmd Create collection testSimple2
   [junit4]   2> 679261 INFO  (OverseerCollectionConfigSetProcessor-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 679465 INFO  (OverseerStateUpdate-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple2_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38135/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 679466 INFO  (OverseerStateUpdate-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple2_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33797/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 679466 INFO  (OverseerStateUpdate-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple2_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38135/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 679467 INFO  (OverseerStateUpdate-98929535857983496-127.0.0.1:33797_solr-n_0000000000) [n:127.0.0.1:33797_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple2_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33797/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 679636 DEBUG (ScheduledTrigger-2385-thread-1) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:39715_solr, 127.0.0.1:33797_solr, 127.0.0.1:38135_solr]
   [junit4]   2> 679670 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 679671 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 679697 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 679697 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 679703 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 679805 INFO  (zkCallback-968-thread-1-processing-n:127.0.0.1:38135_solr) [n:127.0.0.1:38135_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 679805 INFO  (zkCallback-961-thread-1-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 679805 INFO  (zkCallback-961-thread-2-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 679805 INFO  (zkCallback-968-thread-2-processing-n:127.0.0.1:38135_solr) [n:127.0.0.1:38135_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 680636 DEBUG (ScheduledTrigger-2385-thread-1) [n:127.0.0.1:33797_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:39715_solr, 127.0.0.1:33797_solr, 127.0.0.1:38135_solr]
   [junit4]   2> 680679 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 680682 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 680686 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple2_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 680686 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.s.IndexSchema [testSimple2_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 680688 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 680688 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard2_replica_n6' using configuration from collection testSimple2, trusted=true
   [junit4]   2> 680688 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 680688 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard1_replica_n2' using configuration from collection testSimple2, trusted=true
   [junit4]   2> 680688 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33797.solr.core.testSimple2.shard2.replica_n6' (registry 'solr.core.testSimple2.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 680688 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33797.solr.core.testSimple2.shard1.replica_n2' (registry 'solr.core.testSimple2.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 680688 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 680688 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.c.SolrCore [[testSimple2_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node2/testSimple2_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node2/./testSimple2_shard2_replica_n6/data/]
   [junit4]   2> 680688 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 680688 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple2_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node2/testSimple2_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node2/./testSimple2_shard1_replica_n2/data/]
   [junit4]   2> 680705 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 680735 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.s.IndexSchema [testSimple2_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 680737 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 680737 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 680737 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard2_replica_n4' using configuration from collection testSimple2, trusted=true
   [junit4]   2> 680738 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38135.solr.core.testSimple2.shard2.replica_n4' (registry 'solr.core.testSimple2.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 680738 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 680738 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.c.SolrCore [[testSimple2_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node3/testSimple2_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node3/./testSimple2_shard2_replica_n4/data/]
   [junit4]   2> 680746 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple2_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 680747 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 680747 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard1_replica_n1' using configuration from collection testSimple2, trusted=true
   [junit4]   2> 680748 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38135.solr.core.testSimple2.shard1.replica_n1' (registry 'solr.core.testSimple2.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b7b82b0
   [junit4]   2> 680748 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 680748 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore [[testSimple2_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node3/testSimple2_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_7E317C251EB1DB63-001/tempDir-001/node3/./testSimple2_shard1_replica_n1/data/]
   [junit4]   2> 680761 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 680761 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 680762 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 680762 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 680763 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 680763 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 680763 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 680763 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 680764 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@3c3128ea[testSimple2_shard1_replica_n2] main]
   [junit4]   2> 680765 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@5874737d[testSimple2_shard2_replica_n6] main]
   [junit4]   2> 680765 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 680766 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 680766 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 680766 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 680766 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 680767 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 680767 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582872579298820096
   [junit4]   2> 680767 INFO  (searcherExecutor-2415-thread-1-processing-n:127.0.0.1:33797_solr x:testSimple2_shard1_replica_n2 s:shard1 c:testSimple2 r:core_node5) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore [testSimple2_shard1_replica_n2] Registered new searcher Searcher@3c3128ea[testSimple2_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 680767 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582872579298820096
   [junit4]   2> 680769 INFO  (searcherExecutor-2414-thread-1-processing-n:127.0.0.1:33797_solr x:testSimple2_shard2_replica_n6 s:shard2 c:testSimple2 r:core_node8) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.c.SolrCore [testSimple2_shard2_replica_n6] Registered new searcher Searcher@5874737d[testSimple2_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 680776 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 680776 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 680777 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 680777 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 680778 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@7c1dcfa8[testSimple2_shard2_replica_n4] main]
   [junit4]   2> 680779 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 680779 INFO  (qtp1107326822-7243) [n:127.0.0.1:33797_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 680779 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 680780 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 680780 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 680781 INFO  (searcherExecutor-2416-thread-1-processing-n:127.0.0.1:38135_solr x:testSimple2_shard2_replica_n4 s:shard2 c:testSimple2 r:core_node7) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.c.SolrCore [testSimple2_shard2_replica_n4] Registered new searcher Searcher@7c1dcfa8[testSimple2_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 680781 INFO  (qtp1813346647-7258) [n:127.0.0.1:38135_solr c:testSimple2 s:shard2 r:core_node7 x:testSimple2_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582872579313500160
   [junit4]   2> 680793 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 680793 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 680795 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 680795 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 680796 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@495e5ae2[testSimple2_shard1_replica_n1] main]
   [junit4]   2> 680797 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 680797 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 680798 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 680798 INFO  (searcherExecutor-2419-thread-1-processing-n:127.0.0.1:38135_solr x:testSimple2_shard1_replica_n1 s:shard1 c:testSimple2 r:core_node3) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore [testSimple2_shard1_replica_n1] Registered new searcher Searcher@495e5ae2[testSimple2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 680798 INFO  (qtp1813346647-7260) [n:127.0.0.1:38135_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582872579331325952
   [junit4]   2> 680880 INFO  (zkCallback-968-thread-2-processing-n:127.0.0.1:38135_solr) [n:127.0.0.1:38135_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 680880 INFO  (zkCallback-968-thread-1-processing-n:127.0.0.1:38135_solr) [n:127.0.0.1:38135_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 680880 INFO  (zkCallback-961-thread-1-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 680880 INFO  (zkCallback-961-thread-2-processing-n:127.0.0.1:33797_solr) [n:127.0.0.1:33797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 681279 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 681279 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 681279 INFO  (qtp1107326822-7234) [n:127.0.0.1:33797_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:33797/solr/testSimpl

[...truncated too long message...]

229-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1773816 INFO  (zkCallback-2235-thread-1-processing-n:127.0.0.1:41119_solr) [n:127.0.0.1:41119_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 1773816 INFO  (coreCloseExecutor-6319-thread-1) [n:127.0.0.1:41119_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-target_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7d1b42e9
   [junit4]   2> 1773816 INFO  (zkCallback-2235-thread-2-processing-n:127.0.0.1:41119_solr) [n:127.0.0.1:41119_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-target/state.json] for collection [cdcr-target] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1773816 INFO  (coreCloseExecutor-6319-thread-1) [n:127.0.0.1:41119_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.cdcr-target.shard1.replica_n1, tag=2098938601
   [junit4]   2> 1773816 INFO  (zkCallback-2235-thread-3-processing-n:127.0.0.1:41119_solr) [n:127.0.0.1:41119_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-target/state.json] for collection [cdcr-target] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1773816 INFO  (coreCloseExecutor-6319-thread-1) [n:127.0.0.1:41119_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@78ab4e2b: rootName = solr_41119, domain = solr.core.cdcr-target.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.cdcr-target.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@4d4ce24a
   [junit4]   2> 1773825 INFO  (coreCloseExecutor-6319-thread-1) [n:127.0.0.1:41119_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.cdcr-target.shard1.leader, tag=2098938601
   [junit4]   2> 1773825 INFO  (coreCloseExecutor-6319-thread-1) [n:127.0.0.1:41119_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler Solr core is being closed - shutting down CDCR handler @ cdcr-target:shard1
   [junit4]   2> 1773826 INFO  (jetty-closer-2229-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98929606434684931-127.0.0.1:41119_solr-n_0000000000) closing
   [junit4]   2> 1773826 INFO  (OverseerStateUpdate-98929606434684931-127.0.0.1:41119_solr-n_0000000000) [n:127.0.0.1:41119_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41119_solr
   [junit4]   2> 1773827 WARN  (OverseerAutoScalingTriggerThread-98929606434684931-127.0.0.1:41119_solr-n_0000000000) [n:127.0.0.1:41119_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1773829 INFO  (jetty-closer-2229-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@74cd652d{/solr,null,UNAVAILABLE}
   [junit4]   2> 1773829 ERROR (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[7E317C251EB1DB63]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1773829 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[7E317C251EB1DB63]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38251 38251
   [junit4]   2> 1782487 INFO  (Thread-2714) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38251 38251
   [junit4]   2> 1782488 WARN  (Thread-2714) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/collections/cdcr-target/state.json
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/collections/cdcr-target/cdcr/state/process
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 
   [junit4]   2> 1782488 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[7E317C251EB1DB63]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBootstrapWithSourceCluster
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrBootstrapTest_7E317C251EB1DB63-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {_version_=Lucene50(blocksize=128), xyz=BlockTreeOrds(blocksize=128), id=PostingsFormat(name=LuceneFixedGap)}, docValues:{}, maxPointsInLeafNode=1593, maxMBSortInHeap=5.761164746330288, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4e6f1446), locale=fr-CA, timezone=America/Curacao
   [junit4]   2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=131623544,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [ResourceLoaderTest, TestNonDefinedSimilarityFactory, TestManagedSynonymFilterFactory, TestSortByMinMaxFunction, UpdateRequestProcessorFactoryTest, WrapperMergePolicyFactoryTest, DistributedFacetPivotWhiteBoxTest, DistributedQueryElevationComponentTest, TestQueryWrapperFilter, LeaderElectionIntegrationTest, TestExpandComponent, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CleanupOldIndexTest, TestConfigReload, TestPointFields, ConjunctionSolrSpellCheckerTest, TestZkAclsWithHadoopAuth, TestLocalFSCloudBackupRestore, TestEmbeddedSolrServerSchemaAPI, SolrInfoBeanTest, SliceStateTest, TestManagedSchema, TestStandardQParsers, TestOverriddenPrefixQueryForCustomFieldType, TestDynamicLoading, DistributedMLTComponentTest, BasicAuthStandaloneTest, TestReRankQParserPlugin, SoftAutoCommitTest, DateMathParserTest, TestSolrJ, TestJsonFacets, ActionThrottleTest, TestDocTermOrds, TestSchemaResource, TestConfig, TestSuggestSpellingConverter, DistributedSuggestComponentTest, CdcrReplicationHandlerTest, TestConfigsApi, TestFoldingMultitermQuery, TestPhraseSuggestions, DistributedFacetPivotLongTailTest, RuleEngineTest, TestTrackingShardHandlerFactory, ResponseLogComponentTest, TestMergePolicyConfig, SolrSlf4jReporterTest, AnalysisErrorHandlingTest, DistribCursorPagingTest, TemplateUpdateProcessorTest, TestConfigSets, TlogReplayBufferedWhileIndexingTest, TestSystemCollAutoCreate, LeaderElectionContextKeyTest, BasicDistributedZkTest, TestRecovery, DateRangeFieldTest, TestIBSimilarityFactory, PeerSyncWithIndexFingerprintCachingTest, TestBlendedInfixSuggestions, TestFilteredDocIdSet, RemoteQueryErrorTest, MinimalSchemaTest, HdfsThreadLeakTest, TestInPlaceUpdatesStandalone, TestInitParams, TestFieldTypeCollectionResource, RestartWhileUpdatingTest, TestCloudPseudoReturnFields, HdfsWriteToMultipleCollectionsTest, ZkStateReaderTest, TestComponentsName, TestSweetSpotSimilarityFactory, MetricUtilsTest, TestRetrieveFieldsOptimizer, AutoscalingHistoryHandlerTest, BasicFunctionalityTest, SpatialFilterTest, ReplicaListTransformerTest, TestExceedMaxTermLength, JsonLoaderTest, TestComplexPhraseQParserPlugin, SolrPluginUtilsTest, TestSolrDeletionPolicy1, TestConfigSetsAPI, TestDistributedSearch, MergeStrategyTest, TestPKIAuthenticationPlugin, TestClusterProperties, SolrCoreTest, TestCloudNestedDocsSort, BufferStoreTest, TestScoreJoinQPScore, TestFieldCacheWithThreads, TestReqParamsAPI, TestLuceneIndexBackCompat, TestRandomFaceting, TermVectorComponentTest, TestLegacyFieldReuse, TestRequestStatusCollectionAPI, TestBinaryResponseWriter, TestPostingsSolrHighlighter, TestSolrXml, TestQueryUtils, AnalysisAfterCoreReloadTest, RAMDirectoryFactoryTest, TestSolrCLIRunExample, TestBulkSchemaAPI, OverseerTaskQueueTest, TestShardHandlerFactory, TestBadConfig, TestMultiValuedNumericRangeQuery, TestFastOutputStream, RequestLoggingTest, CoreMergeIndexesAdminHandlerTest, TestHighFrequencyDictionaryFactory, SpatialRPTFieldTypeTest, IndexSchemaRuntimeFieldTest, BaseCdcrDistributedZkTest, CoreSorterTest, TestSolrCloudWithDelegationTokens, TestSolrIndexConfig, ManagedSchemaRoundRobinCloudTest, UnloadDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, ShardRoutingTest, ClusterStateUpdateTest, ZkSolrClientTest, ZkCLITest, ShardRoutingCustomTest, ZkControllerTest, TestJoin, TestRangeQuery, SolrCmdDistributorTest, QueryElevationComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFiltering, SolrIndexSplitterTest, TestCoreDiscovery, SuggesterFSTTest, DocValuesTest, SortByFunctionTest, DistanceFunctionTest, CacheHeaderTest, LukeRequestHandlerTest, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, TermsComponentTest, TestSolrQueryParser, LoggingHandlerTest, TestJmxIntegration, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, TestPHPSerializedResponseWriter, TestLFUCache, SampleTest, TestBinaryField, OutputWriterTest, ExternalFileFieldSortTest, NotRequiredUniqueKeyTest, TestCharFilters, TestXIncludeConfig, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, URLClassifyProcessorTest, TestSystemIdResolver, SpellingQueryConverterTest, TestUtils, ZkNodePropsTest, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, CursorPagingTest, TestEmbeddedSolrServerConstructors, ConnectionReuseTest, AsyncCallRequestStatusResponseTest, CdcrBootstrapTest]
   [junit4] Completed [525/747 (2!)] on J0 in 271.03s, 3 tests, 1 error <<< FAILURES!

[...truncated 47974 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20795 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20795/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseParallelGC

4 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.AssignBackwardCompatibilityTest

Error Message:
Error from server at https://127.0.0.1:45667/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:45667/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([2ED374CC7EE9F4A6]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.cloud.AssignBackwardCompatibilityTest.setupCluster(AssignBackwardCompatibilityTest.java:55)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:     1) Thread[id=12632, name=jetty-launcher-1326-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 
   1) Thread[id=12632, name=jetty-launcher-1326-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
	at __randomizedtesting.SeedInfo.seed([2ED374CC7EE9F4A6]:0)


FAILED:  org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testIndexOptimization

Error Message:
Error from server at http://127.0.0.1:35019/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35019/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([2ED374CC7EE9F4A6:24F042317AB4BCEA]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testIndexOptimization(TestSolrCoreSnapshots.java:178)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testBackupRestore

Error Message:
Error from server at http://127.0.0.1:35019/solr: Could not fully create collection: SolrCoreSnapshots

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35019/solr: Could not fully create collection: SolrCoreSnapshots
	at __randomizedtesting.SeedInfo.seed([2ED374CC7EE9F4A6:986874724C5A3AE8]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testBackupRestore(TestSolrCoreSnapshots.java:87)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12393 lines...]
   [junit4] Suite: org.apache.solr.core.snapshots.TestSolrCoreSnapshots
   [junit4]   2> 745670 INFO  (SUITE-TestSolrCoreSnapshots-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCoreSnapshots_2ED374CC7EE9F4A6-001/init-core-data-001
   [junit4]   2> 745671 INFO  (SUITE-TestSolrCoreSnapshots-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 745671 INFO  (SUITE-TestSolrCoreSnapshots-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 745672 INFO  (SUITE-TestSolrCoreSnapshots-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCoreSnapshots_2ED374CC7EE9F4A6-001/tempDir-001
   [junit4]   2> 745672 INFO  (SUITE-TestSolrCoreSnapshots-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 745672 INFO  (Thread-1526) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 745672 INFO  (Thread-1526) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 745673 ERROR (Thread-1526) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 745772 INFO  (SUITE-TestSolrCoreSnapshots-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:39149
   [junit4]   2> 745776 INFO  (jetty-launcher-4556-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 745776 INFO  (jetty-launcher-4556-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3301a7b7{/solr,null,AVAILABLE}
   [junit4]   2> 745778 INFO  (jetty-launcher-4556-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1ce05a17{HTTP/1.1,[http/1.1]}{127.0.0.1:35019}
   [junit4]   2> 745778 INFO  (jetty-launcher-4556-thread-1) [    ] o.e.j.s.Server Started @747591ms
   [junit4]   2> 745778 INFO  (jetty-launcher-4556-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35019}
   [junit4]   2> 745778 ERROR (jetty-launcher-4556-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 745778 INFO  (jetty-launcher-4556-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 745778 INFO  (jetty-launcher-4556-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 745778 INFO  (jetty-launcher-4556-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 745778 INFO  (jetty-launcher-4556-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T10:05:45.005Z
   [junit4]   2> 745783 INFO  (jetty-launcher-4556-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 745787 INFO  (jetty-launcher-4556-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39149/solr
   [junit4]   2> 745811 INFO  (jetty-launcher-4556-thread-1) [n:127.0.0.1:35019_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 745812 INFO  (jetty-launcher-4556-thread-1) [n:127.0.0.1:35019_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35019_solr
   [junit4]   2> 745812 INFO  (jetty-launcher-4556-thread-1) [n:127.0.0.1:35019_solr    ] o.a.s.c.Overseer Overseer (id=98928606897766403-127.0.0.1:35019_solr-n_0000000000) starting
   [junit4]   2> 745815 INFO  (jetty-launcher-4556-thread-1) [n:127.0.0.1:35019_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35019_solr
   [junit4]   2> 745815 INFO  (zkCallback-4563-thread-1-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 745857 INFO  (jetty-launcher-4556-thread-1) [n:127.0.0.1:35019_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35019.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@350ccb03
   [junit4]   2> 745862 INFO  (jetty-launcher-4556-thread-1) [n:127.0.0.1:35019_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35019.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@350ccb03
   [junit4]   2> 745862 INFO  (jetty-launcher-4556-thread-1) [n:127.0.0.1:35019_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35019.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@350ccb03
   [junit4]   2> 745863 INFO  (jetty-launcher-4556-thread-1) [n:127.0.0.1:35019_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCoreSnapshots_2ED374CC7EE9F4A6-001/tempDir-001/node1/.
   [junit4]   2> 745873 INFO  (SUITE-TestSolrCoreSnapshots-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 745874 INFO  (SUITE-TestSolrCoreSnapshots-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39149/solr ready
   [junit4]   2> 745879 INFO  (TEST-TestSolrCoreSnapshots.testIndexOptimization-seed#[2ED374CC7EE9F4A6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testIndexOptimization
   [junit4]   2> 745880 INFO  (qtp1320084395-15776) [n:127.0.0.1:35019_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=SolrCoreSnapshots_IndexOptimization&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 745880 INFO  (OverseerThreadFactory-3135-thread-1-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.CreateCollectionCmd Create collection SolrCoreSnapshots_IndexOptimization
   [junit4]   2> 745983 INFO  (OverseerStateUpdate-98928606897766403-127.0.0.1:35019_solr-n_0000000000) [n:127.0.0.1:35019_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SolrCoreSnapshots_IndexOptimization",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"SolrCoreSnapshots_IndexOptimization_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:35019/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 746185 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=SolrCoreSnapshots_IndexOptimization_shard1_replica_n1&action=CREATE&numShards=1&collection=SolrCoreSnapshots_IndexOptimization&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 746185 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 746287 INFO  (zkCallback-4563-thread-1-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCoreSnapshots_IndexOptimization/state.json] for collection [SolrCoreSnapshots_IndexOptimization] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 746288 INFO  (zkCallback-4563-thread-2-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCoreSnapshots_IndexOptimization/state.json] for collection [SolrCoreSnapshots_IndexOptimization] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 747197 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 747205 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.s.IndexSchema [SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 747208 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 747208 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'SolrCoreSnapshots_IndexOptimization_shard1_replica_n1' using configuration from collection SolrCoreSnapshots_IndexOptimization, trusted=true
   [junit4]   2> 747210 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35019.solr.core.SolrCoreSnapshots_IndexOptimization.shard1.replica_n1' (registry 'solr.core.SolrCoreSnapshots_IndexOptimization.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@350ccb03
   [junit4]   2> 747210 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 747210 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SolrCore [[SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCoreSnapshots_2ED374CC7EE9F4A6-001/tempDir-001/node1/SolrCoreSnapshots_IndexOptimization_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCoreSnapshots_2ED374CC7EE9F4A6-001/tempDir-001/node1/./SolrCoreSnapshots_IndexOptimization_shard1_replica_n1/data/]
   [junit4]   2> 747279 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 747279 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 747280 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 747280 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 747281 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5f8a642a[SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] main]
   [junit4]   2> 747282 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 747282 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 747283 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 747283 INFO  (searcherExecutor-3138-thread-1-processing-n:127.0.0.1:35019_solr x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1 s:shard1 c:SolrCoreSnapshots_IndexOptimization r:core_node2) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SolrCore [SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] Registered new searcher Searcher@5f8a642a[SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 747283 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582857712052469760
   [junit4]   2> 747285 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 747285 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 747286 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35019/solr/SolrCoreSnapshots_IndexOptimization_shard1_replica_n1/
   [junit4]   2> 747286 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 747286 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35019/solr/SolrCoreSnapshots_IndexOptimization_shard1_replica_n1/ has no replicas
   [junit4]   2> 747286 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 747286 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35019/solr/SolrCoreSnapshots_IndexOptimization_shard1_replica_n1/ shard1
   [junit4]   2> 925881 ERROR (qtp1320084395-15776) [n:127.0.0.1:35019_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: create the collection time out:180s
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 925881 INFO  (qtp1320084395-15776) [n:127.0.0.1:35019_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=SolrCoreSnapshots_IndexOptimization&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=500 QTime=180001
   [junit4]   2> 925881 ERROR (qtp1320084395-15776) [n:127.0.0.1:35019_solr    ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: create the collection time out:180s
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 925882 INFO  (TEST-TestSolrCoreSnapshots.testIndexOptimization-seed#[2ED374CC7EE9F4A6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testIndexOptimization
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrCoreSnapshots -Dtests.method=testIndexOptimization -Dtests.seed=2ED374CC7EE9F4A6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=nl-NL -Dtests.timezone=Europe/Tallinn -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR    180s J2 | TestSolrCoreSnapshots.testIndexOptimization <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35019/solr: create the collection time out:180s
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2ED374CC7EE9F4A6:24F042317AB4BCEA]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
   [junit4]    > 	at org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testIndexOptimization(TestSolrCoreSnapshots.java:178)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 925888 INFO  (TEST-TestSolrCoreSnapshots.testBackupRestore-seed#[2ED374CC7EE9F4A6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBackupRestore
   [junit4]   2> 925888 INFO  (qtp1320084395-15777) [n:127.0.0.1:35019_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=SolrCoreSnapshots&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 925890 INFO  (OverseerThreadFactory-3135-thread-2-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.CreateCollectionCmd Create collection SolrCoreSnapshots
   [junit4]   2> 955918 ERROR (OverseerThreadFactory-3135-thread-2-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.OverseerCollectionMessageHandler Collection: SolrCoreSnapshots operation: create failed:org.apache.solr.common.SolrException: Could not fully create collection: SolrCoreSnapshots
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:215)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 955920 INFO  (qtp1320084395-15777) [n:127.0.0.1:35019_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=SolrCoreSnapshots&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=500 QTime=30032
   [junit4]   2> 955921 ERROR (qtp1320084395-15777) [n:127.0.0.1:35019_solr    ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Could not fully create collection: SolrCoreSnapshots
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:307)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 955921 INFO  (TEST-TestSolrCoreSnapshots.testBackupRestore-seed#[2ED374CC7EE9F4A6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBackupRestore
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrCoreSnapshots -Dtests.method=testBackupRestore -Dtests.seed=2ED374CC7EE9F4A6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=nl-NL -Dtests.timezone=Europe/Tallinn -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   30.0s J2 | TestSolrCoreSnapshots.testBackupRestore <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35019/solr: Could not fully create collection: SolrCoreSnapshots
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2ED374CC7EE9F4A6:986874724C5A3AE8]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
   [junit4]    > 	at org.apache.solr.core.snapshots.TestSolrCoreSnapshots.testBackupRestore(TestSolrCoreSnapshots.java:87)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 955922 INFO  (jetty-closer-4557-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1ce05a17{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 955923 INFO  (jetty-closer-4557-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=908003701
   [junit4]   2> 955923 INFO  (jetty-closer-4557-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 955923 INFO  (jetty-closer-4557-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7bff29fa: rootName = solr_35019, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@5d0974cb
   [junit4]   2> 955923 ERROR (OverseerThreadFactory-3135-thread-1-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:35019/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:35019/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:35019 failed to respond
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
   [junit4]   2> 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> 955923 ERROR (OverseerThreadFactory-3135-thread-1-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [SolrCoreSnapshots_IndexOptimization].
   [junit4]   2> 955924 INFO  (OverseerThreadFactory-3135-thread-1-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 955924 ERROR (OverseerThreadFactory-3135-thread-1-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:35019/solr
   [junit4]   2> org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:35019/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:650)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:35019 [/127.0.0.1] failed: Connection refused (Connection refused)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
   [junit4]   2> 	... 12 more
   [junit4]   2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
   [junit4]   2> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
   [junit4]   2> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]   2> 	at java.net.Socket.connect(Socket.java:589)
   [junit4]   2> 	at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
   [junit4]   2> 	... 22 more
   [junit4]   2> 955928 INFO  (jetty-closer-4557-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 955929 INFO  (jetty-closer-4557-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@26cc87b1: rootName = solr_35019, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@13a8ec19
   [junit4]   2> 955932 INFO  (jetty-closer-4557-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 955932 INFO  (jetty-closer-4557-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3bc80866: rootName = solr_35019, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@17976ab4
   [junit4]   2> 955934 INFO  (jetty-closer-4557-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:35019_solr
   [junit4]   2> 955934 INFO  (jetty-closer-4557-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 955934 INFO  (zkCallback-4563-thread-5-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 955934 INFO  (coreCloseExecutor-3143-thread-1) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.SolrCore [SolrCoreSnapshots_IndexOptimization_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@50b50e86
   [junit4]   2> 955934 INFO  (coreCloseExecutor-3143-thread-1) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.SolrCoreSnapshots_IndexOptimization.shard1.replica_n1, tag=1354043014
   [junit4]   2> 955935 INFO  (coreCloseExecutor-3143-thread-1) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@14ce0f40: rootName = solr_35019, domain = solr.core.SolrCoreSnapshots_IndexOptimization.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.SolrCoreSnapshots_IndexOptimization.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@457bbb2c
   [junit4]   2> 955939 INFO  (coreCloseExecutor-3143-thread-1) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.SolrCoreSnapshots_IndexOptimization.shard1.leader, tag=1354043014
   [junit4]   2> 955941 INFO  (jetty-closer-4557-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98928606897766403-127.0.0.1:35019_solr-n_0000000000) closing
   [junit4]   2> 955941 INFO  (OverseerStateUpdate-98928606897766403-127.0.0.1:35019_solr-n_0000000000) [n:127.0.0.1:35019_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:35019_solr
   [junit4]   2> 985980 INFO  (zkCallback-4563-thread-5-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/SolrCoreSnapshots_IndexOptimization/state.json] for collection [SolrCoreSnapshots_IndexOptimization] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 985983 ERROR (OverseerThreadFactory-3135-thread-1-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.OverseerCollectionMessageHandler Collection: SolrCoreSnapshots_IndexOptimization operation: create failed:org.apache.solr.common.SolrException: Could not fully remove collection: SolrCoreSnapshots_IndexOptimization
   [junit4]   2> 	at org.apache.solr.cloud.DeleteCollectionCmd.call(DeleteCollectionCmd.java:109)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.cleanupCollection(OverseerCollectionMessageHandler.java:678)
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:302)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 985983 INFO  (zkCallback-4563-thread-6-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/SolrCoreSnapshots_IndexOptimization/state.json] for collection [SolrCoreSnapshots_IndexOptimization] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 985983 INFO  (OverseerThreadFactory-3135-thread-1-processing-n:127.0.0.1:35019_solr) [n:127.0.0.1:35019_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 985983 WARN  (OverseerAutoScalingTriggerThread-98928606897766403-127.0.0.1:35019_solr-n_0000000000) [n:127.0.0.1:35019_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 985985 INFO  (jetty-closer-4557-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3301a7b7{/solr,null,UNAVAILABLE}
   [junit4]   2> 985986 ERROR (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ZkController Error getting leader from zk
   [junit4]   2> org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: SolrCoreSnapshots_IndexOptimization slice: shard1 saw state=null with live_nodes=[]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:816)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:781)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:890)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1050)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 985987 ERROR (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.c.ZkContainer :org.apache.solr.common.SolrException: Error getting leader from zk for shard shard1
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1207)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:890)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1050)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: SolrCoreSnapshots_IndexOptimization slice: shard1 saw state=null with live_nodes=[]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:816)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:781)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
   [junit4]   2> 	... 41 more
   [junit4]   2> 
   [junit4]   2> 985987 INFO  (qtp1320084395-15778) [n:127.0.0.1:35019_solr c:SolrCoreSnapshots_IndexOptimization s:shard1 r:core_node2 x:SolrCoreSnapshots_IndexOptimization_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=SolrCoreSnapshots_IndexOptimization_shard1_replica_n1&action=CREATE&numShards=1&collection=SolrCoreSnapshots_IndexOptimization&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=239802
   [junit4]   2> 985988 ERROR (SUITE-TestSolrCoreSnapshots-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 985988 INFO  (SUITE-TestSolrCoreSnapshots-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39149 39149
   [junit4]   2> 996790 INFO  (Thread-1526) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39149 39149
   [junit4]   2> 996791 WARN  (Thread-1526) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/aliases.json
   [junit4]   2> 	2	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/collections/SolrCoreSnapshots_IndexOptimization/state.json
   [junit4]   2> 	2	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/live_nodes
   [junit4]   2> 	2	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCoreSnapshots_2ED374CC7EE9F4A6-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@5c78abe2), locale=nl-NL, timezone=Europe/Tallinn
   [junit4]   2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=253030672,total=524812288
   [junit4]   2> NOTE: All tests run in this JVM: [TestDistributedStatsComponentCardinality, EnumFieldTest, MetricsHandlerTest, HdfsBasicDistributedZk2Test, DirectSolrSpellCheckerTest, TestDocBasedVersionConstraints, AliasIntegrationTest, TestCloudPivotFacet, SortByFunctionTest, TestFiltering, DataDrivenBlockJoinTest, DistributedDebugComponentTest, TestReplicationHandlerBackup, DistribJoinFromCollectionTest, TestSegmentSorting, TestSQLHandler, TestFunctionQuery, TestHalfAndHalfDocValues, TestReload, TimeZoneUtilsTest, SystemLogListenerTest, TestConfigSetsAPIZkFailure, SuggesterWFSTTest, SparseHLLTest, TestIndexSearcher, HdfsUnloadDistributedZkTest, TestDistribDocBasedVersion, ReturnFieldsTest, SharedFSAutoReplicaFailoverTest, SegmentsInfoRequestHandlerTest, DistanceFunctionTest, TestStressLiveNodes, IgnoreCommitOptimizeUpdateProcessorFactoryTest, BlobRepositoryCloudTest, MoveReplicaHDFSTest, DisMaxRequestHandlerTest, RequiredFieldsTest, JvmMetricsTest, TestGroupingSearch, OverseerTest, InfixSuggestersTest, TestFieldCacheReopen, TestExtendedDismaxParser, TestChildDocTransformer, FieldMutatingUpdateProcessorTest, TestLegacyField, TestSkipOverseerOperations, UtilsToolTest, BlockDirectoryTest, RecoveryZkTest, TestRawTransformer, LoggingHandlerTest, QueryElevationComponentTest, TestCloudDeleteByQuery, TestCSVResponseWriter, TestClusterStateMutator, BigEndianAscendingWordSerializerTest, TestNumericRangeQuery64, TestHashPartitioner, TestMiniSolrCloudClusterSSL, TestSolrConfigHandler, SolrGangliaReporterTest, TestTolerantUpdateProcessorRandomCloud, HdfsSyncSliceTest, DeleteStatusTest, TestReloadDeadlock, TestFieldCacheVsDocValues, TestRandomRequestDistribution, TestExactSharedStatsCache, VersionInfoTest, TestSmileRequest, MigrateRouteKeyTest, TestSolrDeletionPolicy2, TestManagedSchemaThreadSafety, IndexSchemaTest, TestTolerantSearch, NumberUtilsTest, TestSolrCoreSnapshots]
   [junit4] Completed [254/747 (1!)] on J2 in 251.13s, 2 tests, 2 errors <<< FAILURES!

[...truncated 73 lines...]
   [junit4] Suite: org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
   [junit4]   2> 1071920 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_2ED374CC7EE9F4A6-001/init-core-data-001
   [junit4]   2> 1071920 WARN  (SUITE-TestImpersonationWithHadoopAuth-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> 1071920 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1071921 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1071934 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_2ED374CC7EE9F4A6-001/tempDir-001
   [junit4]   2> 1071934 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1071935 INFO  (Thread-5794) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1071935 INFO  (Thread-5794) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1071940 ERROR (Thread-5794) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1072035 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:40631
   [junit4]   2> 1072039 INFO  (jetty-launcher-1326-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1072039 INFO  (jetty-launcher-1326-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1072039 INFO  (jetty-launcher-1326-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@350e31f{/solr,null,AVAILABLE}
   [junit4]   2> 1072039 INFO  (jetty-launcher-1326-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4a57be5a{/solr,null,AVAILABLE}
   [junit4]   2> 1072039 INFO  (jetty-launcher-1326-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2ead7739{SSL,[ssl, http/1.1]}{127.0.0.1:37293}
   [junit4]   2> 1072039 INFO  (jetty-launcher-1326-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2555afa7{SSL,[ssl, http/1.1]}{127.0.0.1:35357}
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-2) [    ] o.e.j.s.Server Started @1073417ms
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-1) [    ] o.e.j.s.Server Started @1073417ms
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37293}
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35357}
   [junit4]   2> 1072040 ERROR (jetty-launcher-1326-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1072040 ERROR (jetty-launcher-1326-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T10:11:10.828Z
   [junit4]   2> 1072040 INFO  (jetty-launcher-1326-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T10:11:10.828Z
   [junit4]   2> 1072041 INFO  (jetty-launcher-1326-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1072041 INFO  (jetty-launcher-1326-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1072046 INFO  (jetty-launcher-1326-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40631/solr
   [junit4]   2> 1072047 INFO  (jetty-launcher-1326-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40631/solr
   [junit4]   2> 1072085 INFO  (jetty-launcher-1326-thread-2) [n:127.0.0.1:37293_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1072085 INFO  (jetty-launcher-1326-thread-1) [n:127.0.0.1:35357_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1072085 INFO  (jetty-launcher-1326-thread-2) [n:127.0.0.1:37293_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37293_solr
   [junit4]   2> 1072085 INFO  (jetty-launcher-1326-thread-1) [n:127.0.0.1:35357_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35357_solr
   [junit4]   2> 1072086 INFO  (jetty-launcher-1326-thread-2) [n:127.0.0.1:37293_solr    ] o.a.s.c.Overseer Overseer (id=98928628250902534-127.0.0.1:37293_solr-n_0000000000) starting
   [junit4]   2> 1072086 INFO  (zkCallback-1337-thread-1-processing-n:127.0.0.1:35357_solr) [n:127.0.0.1:35357_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1072086 INFO  (zkCallback-1338-thread-1-processing-n:127.0.0.1:37293_solr) [n:127.0.0.1:37293_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1072088 INFO  (jetty-launcher-1326-thread-2) [n:127.0.0.1:37293_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37293_solr
   [junit4]   2> 1072089 INFO  (zkCallback-1338-thread-1-processing-n:127.0.0.1:37293_solr) [n:127.0.0.1:37293_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1072089 INFO  (zkCallback-1337-thread-1-processing-n:127.0.0.1:35357_solr) [n:127.0.0.1:35357_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1072135 INFO  (jetty-launcher-1326-thread-1) [n:127.0.0.1:35357_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
   [junit4]   2> 1072138 INFO  (jetty-launcher-1326-thread-1) [n:127.0.0.1:35357_solr    ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=jenkins, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, zk-dt-secret-manager.enable=true, proxyuser.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, proxyuser.anyHostAnyUser.hosts=*, signer.secret.provider=zookeeper}
   [junit4]   2> 1072171 INFO  (jetty-launcher-1326-thread-2) [n:127.0.0.1:37293_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
   [junit4]   2> 1072171 INFO  (jetty-launcher-1326-thread-2) [n:127.0.0.1:37293_solr    ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=jenkins, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secr

[...truncated too long message...]

> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: collection1 slice: shard1 saw state=null with live_nodes=[]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:816)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:781)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
   [junit4]   2> 	... 44 more
   [junit4]   2> 
   [junit4]   2> 1195301 INFO  (qtp2115723954-8214) [n:127.0.0.1:45667_solr c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=collection1&newCollection=true&name=collection1_shard1_replica_n2&action=CREATE&numShards=1&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=209733
   [junit4]   2> 1195301 ERROR (SUITE-AssignBackwardCompatibilityTest-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1195303 INFO  (SUITE-AssignBackwardCompatibilityTest-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37215 37215
   [junit4]   2> 1200341 INFO  (Thread-2359) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37215 37215
   [junit4]   2> 1200342 WARN  (Thread-2359) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	4	/solr/configs/collection1
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/collection1/managed-schema
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	12	/solr/collections/collection1/state.json
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/overseer_elect/election/98928622529347593-127.0.0.1:45667_solr-n_0000000000
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/98928622529347593-core_node6-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/98928622529347596-127.0.0.1:45387_solr-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/live_nodes
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 
   [junit4]   2> 1200343 INFO  (SUITE-AssignBackwardCompatibilityTest-seed#[2ED374CC7EE9F4A6]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=SimpleText, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@466fad35), locale=bg-BG, timezone=Africa/Juba
   [junit4]   2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=267594744,total=529530880
   [junit4]   2> NOTE: All tests run in this JVM: [CoreSorterTest, TestSQLHandlerNonCloud, UUIDUpdateProcessorFallbackTest, ResourceLoaderTest, OverseerTaskQueueTest, OverseerModifyCollectionTest, TestGeoJSONResponseWriter, LeaderElectionIntegrationTest, DirectUpdateHandlerOptimizeTest, TestExceedMaxTermLength, TestUseDocValuesAsStored, TestFieldTypeCollectionResource, FastVectorHighlighterTest, ClassificationUpdateProcessorFactoryTest, TestIndexingPerformance, DocumentBuilderTest, TestMacros, TestJoin, TestTlogReplica, ZkFailoverTest, TestJsonFacets, QueryParsingTest, TestXmlQParser, ConnectionManagerTest, TestSearcherReuse, ForceLeaderTest, DistributedFacetPivotLongTailTest, TestConfigReload, DistributedQueueTest, TestFastOutputStream, DistributedSuggestComponentTest, TestSolrXml, TestConfigSets, TestFilteredDocIdSet, UpdateParamsTest, JsonLoaderTest, TestCloudInspectUtil, TestBlendedInfixSuggestions, AddSchemaFieldsUpdateProcessorFactoryTest, RestartWhileUpdatingTest, BasicDistributedZkTest, TestSolrCLIRunExample, TestComponentsName, TestPKIAuthenticationPlugin, MinimalSchemaTest, TestConfigsApi, TestExpandComponent, TestConfigSetsAPI, IndexSchemaRuntimeFieldTest, TestLegacyFieldReuse, TestPHPSerializedResponseWriter, TestSubQueryTransformer, OutOfBoxZkACLAndCredentialsProvidersTest, RAMDirectoryFactoryTest, TestCryptoKeys, TestInitParams, NoCacheHeaderTest, RegexBytesRefFilterTest, HdfsCollectionsAPIDistributedZkTest, HdfsBasicDistributedZkTest, BasicAuthStandaloneTest, MissingSegmentRecoveryTest, TestSweetSpotSimilarityFactory, TestReqParamsAPI, SolrMetricReporterTest, LeaderInitiatedRecoveryOnCommitTest, TestSort, TestManagedSynonymFilterFactory, TestDFRSimilarityFactory, TemplateUpdateProcessorTest, NodeLostTriggerTest, MergeStrategyTest, HdfsRecoveryZkTest, TestPointFields, TestStressCloudBlindAtomicUpdates, CoreMergeIndexesAdminHandlerTest, CloneFieldUpdateProcessorFactoryTest, TestHighlightDedupGrouping, AssignBackwardCompatibilityTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=AssignBackwardCompatibilityTest -Dtests.seed=2ED374CC7EE9F4A6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=bg-BG -Dtests.timezone=Africa/Juba -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | AssignBackwardCompatibilityTest (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:45667/solr: create the collection time out:180s
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2ED374CC7EE9F4A6]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
   [junit4]    > 	at org.apache.solr.cloud.AssignBackwardCompatibilityTest.setupCluster(AssignBackwardCompatibilityTest.java:55)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [302/747 (3!)] on J0 in 215.90s, 0 tests, 1 error <<< FAILURES!

[...truncated 48612 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20794 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20794/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CleanupOldIndexTest.test

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
	at __randomizedtesting.SeedInfo.seed([8D3548EF892F0B1E:561773527D366E6]:0)
	at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:440)
	at org.apache.solr.cloud.CleanupOldIndexTest.test(CleanupOldIndexTest.java:114)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12999 lines...]
   [junit4] Suite: org.apache.solr.cloud.CleanupOldIndexTest
   [junit4]   2> 328915 INFO  (SUITE-CleanupOldIndexTest-seed#[8D3548EF892F0B1E]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_8D3548EF892F0B1E-001/init-core-data-001
   [junit4]   2> 328916 WARN  (SUITE-CleanupOldIndexTest-seed#[8D3548EF892F0B1E]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=592 numCloses=592
   [junit4]   2> 328916 INFO  (SUITE-CleanupOldIndexTest-seed#[8D3548EF892F0B1E]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 328917 INFO  (SUITE-CleanupOldIndexTest-seed#[8D3548EF892F0B1E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 328917 INFO  (SUITE-CleanupOldIndexTest-seed#[8D3548EF892F0B1E]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_8D3548EF892F0B1E-001/tempDir-001
   [junit4]   2> 328918 INFO  (SUITE-CleanupOldIndexTest-seed#[8D3548EF892F0B1E]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 328918 INFO  (Thread-737) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 328918 INFO  (Thread-737) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 328933 ERROR (Thread-737) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 329018 INFO  (SUITE-CleanupOldIndexTest-seed#[8D3548EF892F0B1E]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:40551
   [junit4]   2> 329021 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f76614ac30000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 329030 INFO  (jetty-launcher-554-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 329031 INFO  (jetty-launcher-554-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 329040 INFO  (jetty-launcher-554-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a656c6{/solr,null,AVAILABLE}
   [junit4]   2> 329040 INFO  (jetty-launcher-554-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@142c4b{/solr,null,AVAILABLE}
   [junit4]   2> 329045 INFO  (jetty-launcher-554-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@35b042{SSL,[ssl, http/1.1]}{127.0.0.1:39949}
   [junit4]   2> 329045 INFO  (jetty-launcher-554-thread-1) [    ] o.e.j.s.Server Started @330872ms
   [junit4]   2> 329045 INFO  (jetty-launcher-554-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39949}
   [junit4]   2> 329046 ERROR (jetty-launcher-554-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 329046 INFO  (jetty-launcher-554-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 329046 INFO  (jetty-launcher-554-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 329046 INFO  (jetty-launcher-554-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 329046 INFO  (jetty-launcher-554-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T07:00:08.643Z
   [junit4]   2> 329046 INFO  (jetty-launcher-554-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@960cd0{SSL,[ssl, http/1.1]}{127.0.0.1:37707}
   [junit4]   2> 329046 INFO  (jetty-launcher-554-thread-2) [    ] o.e.j.s.Server Started @330873ms
   [junit4]   2> 329046 INFO  (jetty-launcher-554-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37707}
   [junit4]   2> 329047 ERROR (jetty-launcher-554-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 329047 INFO  (jetty-launcher-554-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 329047 INFO  (jetty-launcher-554-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 329047 INFO  (jetty-launcher-554-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 329047 INFO  (jetty-launcher-554-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-01T07:00:08.644Z
   [junit4]   2> 329050 INFO  (jetty-launcher-554-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 329057 INFO  (jetty-launcher-554-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 329059 INFO  (jetty-launcher-554-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40551/solr
   [junit4]   2> 329069 INFO  (jetty-launcher-554-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40551/solr
   [junit4]   2> 329084 INFO  (jetty-launcher-554-thread-2) [n:127.0.0.1:37707_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 329085 INFO  (jetty-launcher-554-thread-2) [n:127.0.0.1:37707_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37707_solr
   [junit4]   2> 329085 INFO  (jetty-launcher-554-thread-2) [n:127.0.0.1:37707_solr    ] o.a.s.c.Overseer Overseer (id=98927877063639046-127.0.0.1:37707_solr-n_0000000000) starting
   [junit4]   2> 329105 INFO  (jetty-launcher-554-thread-2) [n:127.0.0.1:37707_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37707_solr
   [junit4]   2> 329111 INFO  (jetty-launcher-554-thread-1) [n:127.0.0.1:39949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 329112 INFO  (jetty-launcher-554-thread-1) [n:127.0.0.1:39949_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 329112 INFO  (zkCallback-567-thread-1-processing-n:127.0.0.1:37707_solr) [n:127.0.0.1:37707_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 329113 INFO  (jetty-launcher-554-thread-1) [n:127.0.0.1:39949_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39949_solr
   [junit4]   2> 329120 INFO  (zkCallback-562-thread-1-processing-n:127.0.0.1:39949_solr) [n:127.0.0.1:39949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 329120 INFO  (zkCallback-567-thread-1-processing-n:127.0.0.1:37707_solr) [n:127.0.0.1:37707_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 329199 INFO  (jetty-launcher-554-thread-1) [n:127.0.0.1:39949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39949.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e1c243
   [junit4]   2> 329199 INFO  (jetty-launcher-554-thread-2) [n:127.0.0.1:37707_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37707.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e1c243
   [junit4]   2> 329205 INFO  (jetty-launcher-554-thread-1) [n:127.0.0.1:39949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39949.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e1c243
   [junit4]   2> 329205 INFO  (jetty-launcher-554-thread-1) [n:127.0.0.1:39949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39949.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e1c243
   [junit4]   2> 329205 INFO  (jetty-launcher-554-thread-2) [n:127.0.0.1:37707_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37707.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e1c243
   [junit4]   2> 329206 INFO  (jetty-launcher-554-thread-2) [n:127.0.0.1:37707_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37707.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e1c243
   [junit4]   2> 329206 INFO  (jetty-launcher-554-thread-1) [n:127.0.0.1:39949_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_8D3548EF892F0B1E-001/tempDir-001/node1/.
   [junit4]   2> 329206 INFO  (jetty-launcher-554-thread-2) [n:127.0.0.1:37707_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_8D3548EF892F0B1E-001/tempDir-001/node2/.
   [junit4]   2> 329244 INFO  (SUITE-CleanupOldIndexTest-seed#[8D3548EF892F0B1E]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 329244 INFO  (SUITE-CleanupOldIndexTest-seed#[8D3548EF892F0B1E]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40551/solr ready
   [junit4]   2> 329260 INFO  (TEST-CleanupOldIndexTest.test-seed#[8D3548EF892F0B1E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 329302 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=99db97b7-33cf-49a0-b543-c469c213e32a&replicationFactor=2&collection.configName=conf1&name=oldindextest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 329303 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=99db97b7-33cf-49a0-b543-c469c213e32a&replicationFactor=2&collection.configName=conf1&name=oldindextest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 329304 INFO  (OverseerThreadFactory-1437-thread-1-processing-n:127.0.0.1:37707_solr) [n:127.0.0.1:37707_solr    ] o.a.s.c.CreateCollectionCmd Create collection oldindextest
   [junit4]   2> 329304 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 329305 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 329407 INFO  (OverseerStateUpdate-98927877063639046-127.0.0.1:37707_solr-n_0000000000) [n:127.0.0.1:37707_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"oldindextest",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"oldindextest_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39949/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 329408 INFO  (OverseerStateUpdate-98927877063639046-127.0.0.1:37707_solr-n_0000000000) [n:127.0.0.1:37707_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"oldindextest",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"oldindextest_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:37707/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 329639 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=99db97b7-33cf-49a0-b543-c469c213e32a244957175620074&coreNodeName=core_node4&name=oldindextest_shard1_replica_n2&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=6
   [junit4]   2> 329639 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=99db97b7-33cf-49a0-b543-c469c213e32a244957175620074&coreNodeName=core_node4&name=oldindextest_shard1_replica_n2&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 329640 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 329667 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&coreNodeName=core_node3&name=oldindextest_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=0
   [junit4]   2> 329667 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&coreNodeName=core_node3&name=oldindextest_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 329668 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 329668 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 329668 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 329774 INFO  (zkCallback-562-thread-1-processing-n:127.0.0.1:39949_solr) [n:127.0.0.1:39949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 329774 INFO  (zkCallback-567-thread-1-processing-n:127.0.0.1:37707_solr) [n:127.0.0.1:37707_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 329774 INFO  (zkCallback-567-thread-2-processing-n:127.0.0.1:37707_solr) [n:127.0.0.1:37707_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 329774 INFO  (zkCallback-562-thread-2-processing-n:127.0.0.1:39949_solr) [n:127.0.0.1:39949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 330306 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 330307 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 330646 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 330651 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.s.IndexSchema [oldindextest_shard1_replica_n2] Schema name=cloud-dynamic
   [junit4]   2> 330664 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 330664 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'oldindextest_shard1_replica_n2' using configuration from collection oldindextest, trusted=true
   [junit4]   2> 330664 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37707.solr.core.oldindextest.shard1.replica_n2' (registry 'solr.core.oldindextest.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e1c243
   [junit4]   2> 330667 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 330668 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SolrCore [[oldindextest_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_8D3548EF892F0B1E-001/tempDir-001/node2/oldindextest_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_8D3548EF892F0B1E-001/tempDir-001/node2/./oldindextest_shard1_replica_n2/data/]
   [junit4]   2> 330669 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 330669 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 330677 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 330687 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.s.IndexSchema [oldindextest_shard1_replica_n1] Schema name=cloud-dynamic
   [junit4]   2> 330703 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 330703 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'oldindextest_shard1_replica_n1' using configuration from collection oldindextest, trusted=true
   [junit4]   2> 330704 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39949.solr.core.oldindextest.shard1.replica_n1' (registry 'solr.core.oldindextest.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e1c243
   [junit4]   2> 330704 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 330704 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrCore [[oldindextest_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_8D3548EF892F0B1E-001/tempDir-001/node1/oldindextest_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_8D3548EF892F0B1E-001/tempDir-001/node1/./oldindextest_shard1_replica_n1/data/]
   [junit4]   2> 330708 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 330708 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 330708 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 330708 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 330709 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@183cc4e[oldindextest_shard1_replica_n2] main]
   [junit4]   2> 330710 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 330710 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 330711 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 330711 INFO  (searcherExecutor-1442-thread-1-processing-x:oldindextest_shard1_replica_n2 r:core_node4 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE n:127.0.0.1:37707_solr s:shard1 c:oldindextest) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SolrCore [oldindextest_shard1_replica_n2] Registered new searcher Searcher@183cc4e[oldindextest_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 330711 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582846034898321408
   [junit4]   2> 330715 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 330743 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 330743 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 330744 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 330744 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 330745 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@19059b1[oldindextest_shard1_replica_n1] main]
   [junit4]   2> 330745 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 330746 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 330746 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 330747 INFO  (searcherExecutor-1444-thread-1-processing-x:oldindextest_shard1_replica_n1 r:core_node3 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE n:127.0.0.1:39949_solr s:shard1 c:oldindextest) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrCore [oldindextest_shard1_replica_n1] Registered new searcher Searcher@19059b1[oldindextest_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 330747 INFO  (parallelCoreAdminExecutor-1439-thread-1-processing-n:127.0.0.1:39949_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401 CREATE) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582846034936070144
   [junit4]   2> 331215 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 331215 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 331215 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:37707/solr/oldindextest_shard1_replica_n2/
   [junit4]   2> 331216 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=oldindextest_shard1_replica_n2 url=https://127.0.0.1:37707/solr START replicas=[https://127.0.0.1:39949/solr/oldindextest_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 331220 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.S.Request [oldindextest_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 331308 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 331309 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 331516 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=oldindextest_shard1_replica_n2 url=https://127.0.0.1:37707/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 331516 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 331516 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 331516 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 331518 INFO  (parallelCoreAdminExecutor-1438-thread-1-processing-n:127.0.0.1:37707_solr 99db97b7-33cf-49a0-b543-c469c213e32a244957175620074 CREATE) [n:127.0.0.1:37707_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:37707/solr/oldindextest_shard1_replica_n2/ shard1
   [junit4]   2> 331671 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 331671 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 332310 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 332310 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 332672 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 332672 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 333311 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 333312 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 333673 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 333673 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 334314 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 334314 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 334675 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 334675 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 335315 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 335317 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 335677 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 335677 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 336318 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 336319 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 336678 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 336678 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 337321 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 337322 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 337680 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 337680 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 338323 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 338325 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 338681 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 338681 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 339326 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 339327 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 339683 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 339683 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 340328 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 340329 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 340685 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 340685 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 341330 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 341330 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 341686 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 341686 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 342331 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 342332 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 342688 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 342688 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 343333 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 343335 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 343689 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 343689 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 344336 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 344338 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 344690 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 344690 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 345339 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 345340 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 345692 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 345692 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 346341 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 346343 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 346694 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 346694 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 347345 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 347346 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 347695 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 347695 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 348347 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 348348 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 348697 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 348697 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 349349 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 349350 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 349698 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 349698 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 350351 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 350352 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 350700 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 350700 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 351353 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 351355 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 351701 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 351701 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 352356 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 352356 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 352702 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 352703 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 353357 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 353359 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 353704 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 353704 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 354360 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 354361 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 354705 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 354705 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 355362 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 355363 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 355707 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 355707 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 356364 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 356365 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 356708 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 356708 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 357366 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 357367 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 357709 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 357709 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 358368 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 358369 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 358710 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 358710 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 359370 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 359371 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 359711 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 359711 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 360372 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 360373 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 360713 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 360713 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 361375 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 361375 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 361714 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 361714 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 362376 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 362377 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 362716 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 362716 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 363379 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 363379 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 363717 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 363718 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 364380 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 364381 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 364719 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 364719 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 365383 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 365384 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 365720 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 365720 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 366385 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 366385 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 366721 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 366721 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 367387 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 367387 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 367722 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 367722 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 368389 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 368390 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 368723 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 368723 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 369391 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 369392 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 369725 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 369725 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 370393 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 370394 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 370726 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 370726 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 371395 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 371395 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 371727 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 371727 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 372396 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 372397 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 372728 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 372728 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 373398 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 373399 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 373729 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 373729 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 374400 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 374401 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 374730 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 374730 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 375402 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 375403 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 375732 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 375732 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 376404 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 376405 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 376733 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 376733 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 377406 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 377406 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 377735 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 377735 INFO  (qtp1136076-3006) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 378407 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 378408 INFO  (qtp15558238-3020) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 378735 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 378735 INFO  (qtp1136076-3015) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 379408 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 379409 INFO  (qtp15558238-3010) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 379737 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 379737 INFO  (qtp1136076-3016) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 380410 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 380411 INFO  (qtp15558238-3019) [n:127.0.0.1:37707_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 380738 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 99db97b7-33cf-49a0-b543-c469c213e32a244957174630401
   [junit4]   2> 380738 INFO  (qtp1136076-3013) [n:127.0.0.1:39949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=99db97b7-33cf-49a0-b543-c469c213e32a244957174630401&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 381412 INFO  (qtp15558238-3012) [n:127.0.0.1:37707_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=99db97b7-33cf-49a0-b543-c469c213e32a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 381413 INFO  (qtp1555823

[...truncated too long message...]

s:shard1 r:core_node4 x:oldindextest_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.oldindextest.shard1.leader, tag=9636740
   [junit4]   2> 1648009 INFO  (jetty-closer-555-thread-2) [    ] o.a.s.c.Overseer Overseer (id=98927877063639046-127.0.0.1:37707_solr-n_0000000000) closing
   [junit4]   2> 1648009 INFO  (OverseerStateUpdate-98927877063639046-127.0.0.1:37707_solr-n_0000000000) [n:127.0.0.1:37707_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37707_solr
   [junit4]   2> 1648009 WARN  (OverseerAutoScalingTriggerThread-98927877063639046-127.0.0.1:37707_solr-n_0000000000) [n:127.0.0.1:37707_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1648010 INFO  (jetty-closer-555-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@142c4b{/solr,null,UNAVAILABLE}
   [junit4]   2> 1648047 ERROR (coreZkRegister-1454-thread-1-processing-n:127.0.0.1:39949_solr x:oldindextest_shard1_replica_n1 s:shard1 c:oldindextest r:core_node3) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.ZkController Error getting leader from zk
   [junit4]   2> org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: oldindextest slice: shard1 saw state=DocCollection(oldindextest//collections/oldindextest/state.json/2)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"oldindextest_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:39949/solr",
   [junit4]   2>           "node_name":"127.0.0.1:39949_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"oldindextest_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:37707/solr",
   [junit4]   2>           "node_name":"127.0.0.1:37707_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0"} with live_nodes=[]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:816)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:781)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1648047 ERROR (coreZkRegister-1454-thread-1-processing-n:127.0.0.1:39949_solr x:oldindextest_shard1_replica_n1 s:shard1 c:oldindextest r:core_node3) [n:127.0.0.1:39949_solr c:oldindextest s:shard1 r:core_node3 x:oldindextest_shard1_replica_n1] o.a.s.c.ZkContainer :org.apache.solr.common.SolrException: Error getting leader from zk for shard shard1
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1207)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: oldindextest slice: shard1 saw state=DocCollection(oldindextest//collections/oldindextest/state.json/2)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"oldindextest_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:39949/solr",
   [junit4]   2>           "node_name":"127.0.0.1:39949_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"oldindextest_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:37707/solr",
   [junit4]   2>           "node_name":"127.0.0.1:37707_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0"} with live_nodes=[]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:816)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:781)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
   [junit4]   2> 	... 7 more
   [junit4]   2> 
   [junit4]   2> 1648047 INFO  (jetty-closer-555-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@164a6f8{/solr,null,UNAVAILABLE}
   [junit4]   2> 1648048 ERROR (SUITE-CleanupOldIndexTest-seed#[8D3548EF892F0B1E]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1648048 INFO  (SUITE-CleanupOldIndexTest-seed#[8D3548EF892F0B1E]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40551 40551
   [junit4]   2> 1650259 INFO  (Thread-737) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40551 40551
   [junit4]   2> 1650260 WARN  (Thread-737) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 	3	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/collections/oldindextest/state.json
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/collections/oldindextest/leader_elect/shard1/election/98927877063639046-core_node4-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/98927877063639046-127.0.0.1:37707_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/live_nodes
   [junit4]   2> 	4	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_8D3548EF892F0B1E-001
   [junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=2735, maxDocsPerChunk=8, blockSize=689), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=2735, blockSize=689)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@85a500), locale=el-GR, timezone=NST
   [junit4]   2> NOTE: Linux 4.10.0-37-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=98351016,total=334495744
   [junit4]   2> NOTE: All tests run in this JVM: [SolrMetricReporterTest, OverseerModifyCollectionTest, TestPostingsSolrHighlighter, CloneFieldUpdateProcessorFactoryTest, SearchHandlerTest, TestInPlaceUpdatesStandalone, TestSolrJ, TestIndexingPerformance, TestLuceneIndexBackCompat, SaslZkACLProviderTest, PeerSyncWithIndexFingerprintCachingTest, ExternalFileFieldSortTest, ZkStateReaderTest, TestXmlQParser, BitVectorTest, SolrPluginUtilsTest, HdfsDirectoryFactoryTest, PropertiesRequestHandlerTest, TestFieldCacheSort, TestBlendedInfixSuggestions, TestShortCircuitedRequests, TestCloudSchemaless, TestQueryWrapperFilter, TestRandomFaceting, ActionThrottleTest, TestRecovery, DistributedExpandComponentTest, TestSubQueryTransformer, TestMacros, OverseerTaskQueueTest, TestSort, TermsComponentTest, TestSolrCloudWithDelegationTokens, TestTrackingShardHandlerFactory, DeleteInactiveReplicaTest, TestClusterProperties, MultiTermTest, TestCodecSupport, TemplateUpdateProcessorTest, TestCloudInspectUtil, SolrCoreTest, TestJoin, CleanupOldIndexTest]
   [junit4] Completed [422/747 (1!)] on J0 in 1321.35s, 1 test, 1 error <<< FAILURES!

[...truncated 44087 lines...]