You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2019/08/23 13:33:58 UTC

[JENKINS] Lucene-Solr-8.x-Solaris (64bit/jdk1.8.0) - Build # 283 - Still Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Solaris/283/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

5 tests failed.
FAILED:  org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage

Error Message:
Error from server at http://127.0.0.1:51467/solr: Underlying core creation failed while creating collection: globalCacheColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51467/solr: Underlying core creation failed while creating collection: globalCacheColl
	at __randomizedtesting.SeedInfo.seed([37C8E5ACEF30D23D:FBEDB132E46764DE]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:656)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
	at org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage(TestContainerReqHandler.java:687)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage

Error Message:
Error from server at http://127.0.0.1:40094/solr: Underlying core creation failed while creating collection: globalCacheColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40094/solr: Underlying core creation failed while creating collection: globalCacheColl
	at __randomizedtesting.SeedInfo.seed([37C8E5ACEF30D23D:FBEDB132E46764DE]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:656)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
	at org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage(TestContainerReqHandler.java:687)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage

Error Message:
Error from server at http://127.0.0.1:46795/solr: Underlying core creation failed while creating collection: globalCacheColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46795/solr: Underlying core creation failed while creating collection: globalCacheColl
	at __randomizedtesting.SeedInfo.seed([37C8E5ACEF30D23D:FBEDB132E46764DE]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:656)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
	at org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage(TestContainerReqHandler.java:687)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage

Error Message:
Error from server at http://127.0.0.1:44025/solr: Underlying core creation failed while creating collection: globalCacheColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:44025/solr: Underlying core creation failed while creating collection: globalCacheColl
	at __randomizedtesting.SeedInfo.seed([37C8E5ACEF30D23D:FBEDB132E46764DE]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:656)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
	at org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage(TestContainerReqHandler.java:687)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage

Error Message:
Error from server at http://127.0.0.1:38011/solr: Underlying core creation failed while creating collection: globalCacheColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38011/solr: Underlying core creation failed while creating collection: globalCacheColl
	at __randomizedtesting.SeedInfo.seed([37C8E5ACEF30D23D:FBEDB132E46764DE]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:656)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
	at org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage(TestContainerReqHandler.java:687)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 15366 lines...]
   [junit4] Suite: org.apache.solr.handler.TestContainerReqHandler
   [junit4]   2> 3922327 INFO  (SUITE-TestContainerReqHandler-seed#[37C8E5ACEF30D23D]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_37C8E5ACEF30D23D-001/data-dir-343-001
   [junit4]   2> 3922327 WARN  (SUITE-TestContainerReqHandler-seed#[37C8E5ACEF30D23D]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=13 numCloses=13
   [junit4]   2> 3922327 INFO  (SUITE-TestContainerReqHandler-seed#[37C8E5ACEF30D23D]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 3922329 INFO  (SUITE-TestContainerReqHandler-seed#[37C8E5ACEF30D23D]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 3922329 INFO  (SUITE-TestContainerReqHandler-seed#[37C8E5ACEF30D23D]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 3922332 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testCacheLoadFromPackage
   [junit4]   2> 3922372 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; jvm 1.8.0_221-b11
   [junit4]   2> 3922374 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@4fc111f3{HTTP/1.1,[http/1.1]}{0.0.0.0:47537}
   [junit4]   2> 3922374 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.e.j.s.Server Started @3924049ms
   [junit4]   2> 3922374 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_37C8E5ACEF30D23D-001/tempDir-001
   [junit4]   2> 3922374 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 3922375 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3922375 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 3922474 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.ZkTestServer start zk server on port:37713
   [junit4]   2> 3922475 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:37713
   [junit4]   2> 3922475 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:37713
   [junit4]   2> 3922475 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 37713
   [junit4]   2> 3922483 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3922510 INFO  (zkConnectionManagerCallback-26505-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3922510 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3922520 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3922544 INFO  (zkConnectionManagerCallback-26507-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3922545 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3922547 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3922549 INFO  (zkConnectionManagerCallback-26509-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3922549 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3922652 WARN  (jetty-launcher-26510-thread-2) [     ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 3922652 WARN  (jetty-launcher-26510-thread-1) [     ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 3922652 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 3922652 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 3922652 INFO  (jetty-launcher-26510-thread-2) [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; jvm 1.8.0_221-b11
   [junit4]   2> 3922652 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 3922652 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 3922652 WARN  (jetty-launcher-26510-thread-3) [     ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 3922652 INFO  (jetty-launcher-26510-thread-1) [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; jvm 1.8.0_221-b11
   [junit4]   2> 3922652 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 3922652 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 3922652 INFO  (jetty-launcher-26510-thread-3) [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; jvm 1.8.0_221-b11
   [junit4]   2> 3922653 WARN  (jetty-launcher-26510-thread-4) [     ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 3922654 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 3922654 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 3922654 INFO  (jetty-launcher-26510-thread-4) [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; jvm 1.8.0_221-b11
   [junit4]   2> 3922654 INFO  (jetty-launcher-26510-thread-3) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3922654 INFO  (jetty-launcher-26510-thread-3) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3922654 INFO  (jetty-launcher-26510-thread-3) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 3922655 INFO  (jetty-launcher-26510-thread-4) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3922655 INFO  (jetty-launcher-26510-thread-4) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3922655 INFO  (jetty-launcher-26510-thread-4) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 3922655 INFO  (jetty-launcher-26510-thread-3) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@50614f34{/solr,null,AVAILABLE}
   [junit4]   2> 3922657 INFO  (jetty-launcher-26510-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3922657 INFO  (jetty-launcher-26510-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3922657 INFO  (jetty-launcher-26510-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 3922657 INFO  (jetty-launcher-26510-thread-4) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@47522dde{/solr,null,AVAILABLE}
   [junit4]   2> 3922658 INFO  (jetty-launcher-26510-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3922658 INFO  (jetty-launcher-26510-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3922658 INFO  (jetty-launcher-26510-thread-2) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 3922658 INFO  (jetty-launcher-26510-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2fa46b68{/solr,null,AVAILABLE}
   [junit4]   2> 3922658 INFO  (jetty-launcher-26510-thread-3) [     ] o.e.j.s.AbstractConnector Started ServerConnector@52f64e06{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:38011}
   [junit4]   2> 3922658 INFO  (jetty-launcher-26510-thread-3) [     ] o.e.j.s.Server Started @3924334ms
   [junit4]   2> 3922658 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38011}
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@59515fc2{/solr,null,AVAILABLE}
   [junit4]   2> 3922659 ERROR (jetty-launcher-26510-thread-3) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@77fe8e2{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:36830}
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-1) [     ] o.e.j.s.Server Started @3924334ms
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36830}
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.3.0
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-08-23T12:47:06.327Z
   [junit4]   2> 3922659 ERROR (jetty-launcher-26510-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.3.0
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-08-23T12:47:06.327Z
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-4) [     ] o.e.j.s.AbstractConnector Started ServerConnector@733fd7a2{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:63867}
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-4) [     ] o.e.j.s.Server Started @3924334ms
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63867}
   [junit4]   2> 3922659 ERROR (jetty-launcher-26510-thread-4) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.3.0
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3922659 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-08-23T12:47:06.327Z
   [junit4]   2> 3922660 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3922660 INFO  (jetty-launcher-26510-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@51e32f32{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:64734}
   [junit4]   2> 3922660 INFO  (jetty-launcher-26510-thread-2) [     ] o.e.j.s.Server Started @3924335ms
   [junit4]   2> 3922660 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64734}
   [junit4]   2> 3922660 ERROR (jetty-launcher-26510-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3922660 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 3922660 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.3.0
   [junit4]   2> 3922660 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3922660 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3922660 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-08-23T12:47:06.328Z
   [junit4]   2> 3922660 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3922661 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3922661 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3922662 INFO  (zkConnectionManagerCallback-26512-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3922662 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3922662 INFO  (zkConnectionManagerCallback-26514-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3922662 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3922663 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3922663 INFO  (zkConnectionManagerCallback-26516-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3922663 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3922663 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3922663 INFO  (zkConnectionManagerCallback-26518-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3922663 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3922664 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3922665 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3924176 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 3924177 WARN  (jetty-launcher-26510-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@355e4168[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924177 WARN  (jetty-launcher-26510-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@355e4168[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924180 WARN  (jetty-launcher-26510-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6dcc7ff2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924180 WARN  (jetty-launcher-26510-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6dcc7ff2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924181 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37713/solr
   [junit4]   2> 3924181 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924183 INFO  (zkConnectionManagerCallback-26528-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924183 INFO  (jetty-launcher-26510-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924286 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924287 INFO  (zkConnectionManagerCallback-26530-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924287 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924391 DEBUG (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3924391 DEBUG (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 3924392 DEBUG (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> []
   [junit4]   2> 3924392 DEBUG (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 3924396 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38011_solr
   [junit4]   2> 3924397 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.Overseer Overseer (id=72169015446208520-127.0.0.1:38011_solr-n_0000000000) starting
   [junit4]   2> 3924403 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924404 INFO  (zkConnectionManagerCallback-26537-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924404 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924404 DEBUG (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3924405 DEBUG (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 3924405 DEBUG (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> []
   [junit4]   2> 3924406 DEBUG (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 3924407 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37713/solr ready
   [junit4]   2> 3924408 INFO  (OverseerStateUpdate-72169015446208520-127.0.0.1:38011_solr-n_0000000000) [n:127.0.0.1:38011_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:38011_solr
   [junit4]   2> 3924409 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38011_solr
   [junit4]   2> 3924412 DEBUG (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 3924412 DEBUG (zkCallback-26529-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 3924412 INFO  (OverseerStateUpdate-72169015446208520-127.0.0.1:38011_solr-n_0000000000) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3924412 DEBUG (OverseerStateUpdate-72169015446208520-127.0.0.1:38011_solr-n_0000000000) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:38011_solr]
   [junit4]   2> 3924412 INFO  (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3924412 DEBUG (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:38011_solr]
   [junit4]   2> 3924413 DEBUG (OverseerStateUpdate-72169015446208520-127.0.0.1:38011_solr-n_0000000000) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 3924414 DEBUG (zkCallback-26529-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr] -> [127.0.0.1:38011_solr]
   [junit4]   2> 3924415 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.PackageManager clusterprops.json changed , version -1
   [junit4]   2> 3924452 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 3924477 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38011.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3924484 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38011.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3924484 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38011.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3924485 INFO  (jetty-launcher-26510-thread-3) [n:127.0.0.1:38011_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_37C8E5ACEF30D23D-001/tempDir-001/node3/.
   [junit4]   2> 3924677 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 3924678 WARN  (jetty-launcher-26510-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3c894d6f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924678 WARN  (jetty-launcher-26510-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3c894d6f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924679 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 3924680 WARN  (jetty-launcher-26510-thread-4) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@65480a2c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924680 WARN  (jetty-launcher-26510-thread-4) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@65480a2c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924680 WARN  (jetty-launcher-26510-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5ed3d535[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924681 WARN  (jetty-launcher-26510-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5ed3d535[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924681 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37713/solr
   [junit4]   2> 3924682 WARN  (jetty-launcher-26510-thread-4) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2dbe784[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924682 WARN  (jetty-launcher-26510-thread-4) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2dbe784[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924682 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924684 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37713/solr
   [junit4]   2> 3924684 INFO  (zkConnectionManagerCallback-26546-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924684 INFO  (jetty-launcher-26510-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924685 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924687 INFO  (zkConnectionManagerCallback-26550-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924687 INFO  (jetty-launcher-26510-thread-4) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924761 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 3924762 WARN  (jetty-launcher-26510-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@64e1065c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924762 WARN  (jetty-launcher-26510-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@64e1065c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924764 WARN  (jetty-launcher-26510-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@69de60ef[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924764 WARN  (jetty-launcher-26510-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@69de60ef[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 3924765 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37713/solr
   [junit4]   2> 3924765 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924767 INFO  (zkConnectionManagerCallback-26556-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924767 INFO  (jetty-launcher-26510-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924792 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924794 INFO  (zkConnectionManagerCallback-26558-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924794 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924895 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924896 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924897 INFO  (zkConnectionManagerCallback-26560-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924897 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924899 INFO  (zkConnectionManagerCallback-26562-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924899 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924904 DEBUG (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3924905 DEBUG (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 3924906 DEBUG (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3924907 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3924907 DEBUG (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:38011_solr]
   [junit4]   2> 3924908 DEBUG (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 3924908 DEBUG (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 3924909 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3924909 DEBUG (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:38011_solr]
   [junit4]   2> 3924910 DEBUG (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3924910 DEBUG (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 3924912 DEBUG (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 3924914 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3924914 DEBUG (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:38011_solr]
   [junit4]   2> 3924915 DEBUG (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 3924916 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:64734_solr as DOWN
   [junit4]   2> 3924918 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:63867_solr as DOWN
   [junit4]   2> 3924918 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 3924918 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64734_solr
   [junit4]   2> 3924924 DEBUG (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3924924 DEBUG (zkCallback-26529-thread-2) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3924924 INFO  (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3924924 DEBUG (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr] -> [127.0.0.1:38011_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924924 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 3924924 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63867_solr
   [junit4]   2> 3924925 DEBUG (zkCallback-26559-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3924925 INFO  (zkCallback-26529-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3924925 DEBUG (zkCallback-26529-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr] -> [127.0.0.1:38011_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924926 DEBUG (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 3924926 DEBUG (zkCallback-26529-thread-2) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 3924926 DEBUG (zkCallback-26557-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3924926 INFO  (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3924926 DEBUG (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr, 127.0.0.1:64734_solr] -> [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924926 INFO  (zkCallback-26529-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3924926 DEBUG (zkCallback-26529-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr, 127.0.0.1:64734_solr] -> [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924926 INFO  (zkCallback-26559-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 3924927 DEBUG (zkCallback-26559-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr] -> [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924927 INFO  (zkCallback-26557-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 3924927 DEBUG (zkCallback-26557-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr] -> [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924928 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924928 DEBUG (zkCallback-26561-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3924929 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924930 INFO  (zkCallback-26561-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 3924930 DEBUG (zkCallback-26561-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr] -> [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924930 INFO  (zkConnectionManagerCallback-26573-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924930 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924930 DEBUG (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3924931 INFO  (zkConnectionManagerCallback-26578-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924931 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924932 DEBUG (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3924932 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:36830_solr as DOWN
   [junit4]   2> 3924932 DEBUG (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 3924933 DEBUG (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 3924933 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 3924933 DEBUG (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924934 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 3924934 DEBUG (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 3924934 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36830_solr
   [junit4]   2> 3924934 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 3924935 DEBUG (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924936 DEBUG (zkCallback-26529-thread-2) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 3924936 DEBUG (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 3924936 INFO  (zkCallback-26529-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3924936 DEBUG (zkCallback-26529-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr] -> [127.0.0.1:36830_solr, 127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924936 INFO  (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3924936 DEBUG (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr] -> [127.0.0.1:36830_solr, 127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924937 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37713/solr ready
   [junit4]   2> 3924937 DEBUG (zkCallback-26577-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 3924937 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.PackageManager clusterprops.json changed , version -1
   [junit4]   2> 3924937 DEBUG (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 3924937 DEBUG (zkCallback-26572-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 3924938 DEBUG (zkCallback-26557-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 3924938 INFO  (zkCallback-26572-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3924938 INFO  (zkCallback-26557-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3924938 DEBUG (zkCallback-26572-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr] -> [127.0.0.1:36830_solr, 127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924938 DEBUG (zkCallback-26557-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr] -> [127.0.0.1:36830_solr, 127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924938 DEBUG (zkCallback-26559-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 3924939 INFO  (zkCallback-26559-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3924939 DEBUG (zkCallback-26559-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr] -> [127.0.0.1:36830_solr, 127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924939 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37713/solr ready
   [junit4]   2> 3924939 INFO  (zkCallback-26577-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3924939 DEBUG (zkCallback-26577-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr] -> [127.0.0.1:36830_solr, 127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924940 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.PackageManager clusterprops.json changed , version -1
   [junit4]   2> 3924940 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3924941 DEBUG (zkCallback-26561-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 3924942 INFO  (zkCallback-26561-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3924942 DEBUG (zkCallback-26561-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr] -> [127.0.0.1:36830_solr, 127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924942 INFO  (zkConnectionManagerCallback-26583-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3924942 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3924943 DEBUG (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3924944 DEBUG (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 3924945 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 3924945 DEBUG (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:36830_solr, 127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3924945 DEBUG (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 3924946 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37713/solr ready
   [junit4]   2> 3924946 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.PackageManager clusterprops.json changed , version -1
   [junit4]   2> 3924961 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 3924961 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 3924963 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 3925077 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63867.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3925078 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36830.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3925079 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64734.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3925110 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64734.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3925111 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64734.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3925117 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63867.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3925117 INFO  (jetty-launcher-26510-thread-2) [n:127.0.0.1:64734_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_37C8E5ACEF30D23D-001/tempDir-001/node1/.
   [junit4]   2> 3925117 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63867.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3925117 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36830.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3925117 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36830.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e536827
   [junit4]   2> 3925119 INFO  (jetty-launcher-26510-thread-4) [n:127.0.0.1:63867_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_37C8E5ACEF30D23D-001/tempDir-001/node4/.
   [junit4]   2> 3925119 INFO  (jetty-launcher-26510-thread-1) [n:127.0.0.1:36830_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_37C8E5ACEF30D23D-001/tempDir-001/node2/.
   [junit4]   2> 3925245 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=4
   [junit4]   2> 3925245 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3925247 INFO  (zkConnectionManagerCallback-26591-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3925247 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3925247 DEBUG (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3925249 DEBUG (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 3925250 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 3925250 DEBUG (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:36830_solr, 127.0.0.1:38011_solr, 127.0.0.1:63867_solr, 127.0.0.1:64734_solr]
   [junit4]   2> 3925251 DEBUG (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 3925253 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37713/solr ready
   [junit4]   2> 3925265 INFO  (qtp1596250790-67834) [n:127.0.0.1:64734_solr     ] o.a.s.c.CloudUtil Error fetching key names
   [junit4]   2> 3925267 DEBUG (zkCallback-26559-thread-1) [     ] o.a.s.c.c.ZkStateReader Loaded cluster properties: {package={cache_pkg={name=cache_pkg, url=http://localhost:47537/jar1.jar, sha512=1a3739b629ce85895c9b2a8c12dd7d98161ff47634b0693f1e1c5b444fb38343f95c6ee955cd99103bd24cfde6c205234b63823818660ac08392cdc626caf585}}} to version 0
   [junit4]   2> 3925267 INFO  (zkCallback-26559-thread-1) [     ] o.a.s.c.PackageManager clusterprops.json changed , version 0
   [junit4]   2> 3925267 DEBUG (zkCallback-26529-thread-2) [     ] o.a.s.c.c.ZkStateReader Loaded cluster properties: {package={cache_pkg={name=cache_pkg, url=http://localhost:47537/jar1.jar, sha512=1a3739b629ce85895c9b2a8c12dd7d98161ff47634b0693f1e1c5b444fb38343f95c6ee955cd99103bd24cfde6c205234b63823818660ac08392cdc626caf585}}} to version 0
   [junit4]   2> 3925268 INFO  (zkCallback-26529-thread-2) [     ] o.a.s.c.PackageManager clusterprops.json changed , version 0
   [junit4]   2> 3925273 DEBUG (zkCallback-26577-thread-1) [     ] o.a.s.c.c.ZkStateReader Loaded cluster properties: {package={cache_pkg={name=cache_pkg, url=http://localhost:47537/jar1.jar, sha512=1a3739b629ce85895c9b2a8c12dd7d98161ff47634b0693f1e1c5b444fb38343f95c6ee955cd99103bd24cfde6c205234b63823818660ac08392cdc626caf585}}} to version 0
   [junit4]   2> 3925274 DEBUG (zkCallback-26582-thread-1) [     ] o.a.s.c.c.ZkStateReader Loaded cluster properties: {package={cache_pkg={name=cache_pkg, url=http://localhost:47537/jar1.jar, sha512=1a3739b629ce85895c9b2a8c12dd7d98161ff47634b0693f1e1c5b444fb38343f95c6ee955cd99103bd24cfde6c205234b63823818660ac08392cdc626caf585}}} to version 0
   [junit4]   2> 3925274 DEBUG (zkCallback-26590-thread-1) [     ] o.a.s.c.c.ZkStateReader Loaded cluster properties: {package={cache_pkg={name=cache_pkg, url=http://localhost:47537/jar1.jar, sha512=1a3739b629ce85895c9b2a8c12dd7d98161ff47634b0693f1e1c5b444fb38343f95c6ee955cd99103bd24cfde6c205234b63823818660ac08392cdc626caf585}}} to version 0
   [junit4]   2> 3925275 INFO  (zkCallback-26529-thread-2) [     ] o.a.s.c.CloudUtil Error fetching key names
   [junit4]   2> 3925276 INFO  (zkCallback-26529-thread-2) [     ] o.a.s.c.PackageManager Libraries changed. New memclassloader created with jars [http://localhost:47537/jar1.jar]
   [junit4]   2> 3925276 DEBUG (zkCallback-26536-thread-1) [     ] o.a.s.c.c.ZkStateReader Loaded cluster properties: {package={cache_pkg={name=cache_pkg, url=http://localhost:47537/jar1.jar, sha512=1a3739b629ce85895c9b2a8c12dd7d98161ff47634b0693f1e1c5b444fb38343f95c6ee955cd99103bd24cfde6c205234b63823818660ac08392cdc626caf585}}} to version 0
   [junit4]   2> 3925277 INFO  (qtp1596250790-67834) [n:127.0.0.1:64734_solr     ] o.a.s.c.PackageManager clusterprops.json changed , version -1
   [junit4]   2> 3925282 DEBUG (zkCallback-26557-thread-1) [     ] o.a.s.c.c.ZkStateReader Loaded cluster properties: {package={cache_pkg={name=cache_pkg, url=http://localhost:47537/jar1.jar, sha512=1a3739b629ce85895c9b2a8c12dd7d98161ff47634b0693f1e1c5b444fb38343f95c6ee955cd99103bd24cfde6c205234b63823818660ac08392cdc626caf585}}} to version 0
   [junit4]   2> 3925282 INFO  (zkCallback-26557-thread-1) [     ] o.a.s.c.PackageManager clusterprops.json changed , version 0
   [junit4]   2> 3925283 INFO  (qtp1596250790-67834) [n:127.0.0.1:64734_solr     ] o.a.s.c.CloudUtil Error fetching key names
   [junit4]   2> 3925284 DEBUG (zkCallback-26572-thread-1) [     ] o.a.s.c.c.ZkStateReader Loaded cluster properties: {package={cache_pkg={name=cache_pkg, url=http://localhost:47537/jar1.jar, sha512=1a3739b629ce85895c9b2a8c12dd7d98161ff47634b0693f1e1c5b444fb38343f95c6ee955cd99103bd24cfde6c205234b63823818660ac08392cdc626caf585}}} to version 0
   [junit4]   2> 3925284 INFO  (qtp1596250790-67834) [n:127.0.0.1:64734_solr     ] o.a.s.c.PackageManager Libraries changed. New memclassloader created with jars [http://localhost:47537/jar1.jar]
   [junit4]   2> 3925284 INFO  (qtp1596250790-67834) [n:127.0.0.1:64734_solr     ] o.a.s.h.a.CollectionHandlerApi current version of clusterprops.json is 0 , trying to get every node to update 
   [junit4]   2> 3925284 DEBUG (qtp1596250790-67834) [n:127.0.0.1:64734_solr     ] o.a.s.h.a.CollectionHandlerApi The current clusterprops.json:  {package={cache_pkg={name=cache_pkg, url=http://localhost:47537/jar1.jar, sha512=1a3739b629ce85895c9b2a8c12dd7d98161ff47634b0693f1e1c5b444fb38343f95c6ee955cd99103bd24cfde6c205234b63823818660ac08392cdc626caf585}}}
   [junit4]   2> 3925285 INFO  (zkCallback-26559-thread-1) [     ] o.a.s.c.CloudUtil Error fetching key names
   [junit4]   2> 3925286 INFO  (zkCallback-26557-thread-1) [     ] o.a.s.c.CloudUtil Error fetching key names
   [junit4]   2> 3925290 DEBUG (zkCallback-26561-thread-1) [     ] o.a.s.c.c.ZkStateReader Loaded cluster properties: {package={cache_pkg={name=cache_pkg, url=http://localhost:47537/jar1.jar, sha512=1a3739b629ce85895c9b2a8c12dd7d98161ff47634b0693f1e1c5b444fb38343f95c6ee955cd99103bd24cfde6c205234b63823818660ac08392cdc626caf585}}} to version 0
   [junit4]   2> 3925290 INFO  (zkCallback-26557-thread-1) [     ] o.a.s.c.PackageManager Libraries changed. New memclassloader created with jars [http://localhost:47537/jar1.jar]
   [junit4]   2> 3925290 INFO  (zkCallback-26561-thread-1) [     ] o.a.s.c.PackageManager clusterprops.json changed , version 0
   [junit4]   2> 3925291 INFO  (zkCallback-26559-thread-1) [     ] o.a.s.c.PackageManager Libraries changed. New memclassloader created with jars [http://localhost:47537/jar1.jar]
   [junit4]   2> 3925293 INFO  (zkCallback-26561-thread-1) [     ] o.a.s.c.CloudUtil Error fetching key names
   [junit4]   2> 3925294 INFO  (zkCallback-26561-thread-1) [     ] o.a.s.c.PackageManager Libraries changed. New memclassloader created with jars [http://localhost:47537/jar1.jar]
   [junit4]   2> 3925300 INFO  (qtp1596250790-67834) [n:127.0.0.1:64734_solr     ] o.a.s.h.a.CollectionHandlerApi Waiting up to 30 secs for 4 nodes to update clusterprops to be of version 0 
   [junit4]   2> 3925306 INFO  (solrHandlerExecutor-18253-thread-2-processing-n:127.0.0.1:64734_solr) [n:127.0.0.1:64734_solr     ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 3925306 INFO  (solrHandlerExecutor-18253-thread-4-processing-n:127.0.0.1:64734_solr) [n:127.0.0.1:64734_solr     ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 3925307 INFO  (solrHandlerExecutor-18253-thread-3-processing-n:127.0.0.1:64734_solr) [n:127.0.0.1:64734_solr     ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 3925307 INFO  (solrHandlerExecutor-18253-thread-1-processing-n:127.0.0.1:64734_solr) [n:127.0.0.1:64734_solr     ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 3925422 DEBUG (qtp1546763248-67808) [n:127.0.0.1:38011_solr     ] o.a.s.c.PackageManager expected version : 0 , my version 0
   [junit4]   2> 3925422 DEBUG (qtp1546763248-67808) [n:127.0.0.1:38011_solr     ] o.a.s.c.c.ZkStateReader Expected version of clusterprops.json is 0 , my version is 0
   [junit4]   2> 3925422 INFO  (qtp1546763248-67808) [n:127.0.0.1:38011_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/node/ext params={znodeVersion=0&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 3925423 DEBUG (qtp1596250790-67836) [n:127.0.0.1:64734_solr     ] o.a.s.c.PackageManager expected version : 0 , my version 0
   [junit4]   2> 3925423 DEBUG (qtp1596250790-67836) [n:127.0.0.1:64734_solr     ] o.a.s.c.c.ZkStateReader Expected version of clusterprops.json is 0 , my version is 0
   [junit4]   2> 3925423 INFO  (qtp1596250790-67836) [n:127.0.0.1:64734_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/node/ext params={znodeVersion=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3925432 DEBUG (qtp2113414765-67818) [n:127.0.0.1:63867_solr     ] o.a.s.c.PackageManager expected version : 0 , my version 0
   [junit4]   2> 3925432 DEBUG (qtp2113414765-67818) [n:127.0.0.1:63867_solr     ] o.a.s.c.c.ZkStateReader Expected version of clusterprops.json is 0 , my version is 0
   [junit4]   2> 3925432 INFO  (qtp2113414765-67818) [n:127.0.0.1:63867_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/node/ext params={znodeVersion=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3925433 DEBUG (qtp163055525-67826) [n:127.0.0.1:36830_solr     ] o.a.s.c.PackageManager expected version : 0 , my version 0
   [junit4]   2> 3925433 DEBUG (qtp163055525-67826) [n:127.0.0.1:36830_solr     ] o.a.s.c.c.ZkStateReader Expect

[...truncated too long message...]

Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 158812 DEBUG (zkCallback-2127-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
   [junit4]   2> 158812 INFO  (jetty-closer-2150-thread-4) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4b1468c5: rootName = solr_62104, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@9b12993
   [junit4]   2> 158812 INFO  (jetty-closer-2150-thread-4) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 158813 INFO  (zkCallback-2095-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (2)
   [junit4]   2> 158813 DEBUG (zkCallback-2095-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:33008_solr, 127.0.0.1:60017_solr, 127.0.0.1:62104_solr, 127.0.0.1:63433_solr] -> [127.0.0.1:33008_solr, 127.0.0.1:62104_solr]
   [junit4]   2> 158813 INFO  (zkCallback-2134-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (2)
   [junit4]   2> 158813 DEBUG (zkCallback-2134-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:33008_solr, 127.0.0.1:60017_solr, 127.0.0.1:62104_solr, 127.0.0.1:63433_solr] -> [127.0.0.1:33008_solr, 127.0.0.1:62104_solr]
   [junit4]   2> 158814 INFO  (closeThreadPool-2163-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72169195996971016-127.0.0.1:60017_solr-n_0000000000) closing
   [junit4]   2> 158912 INFO  (jetty-closer-2150-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72169195996971016-127.0.0.1:60017_solr-n_0000000000) closing
   [junit4]   2> 158921 INFO  (zkCallback-2127-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (1)
   [junit4]   2> 158921 DEBUG (zkCallback-2127-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:33008_solr, 127.0.0.1:60017_solr, 127.0.0.1:62104_solr, 127.0.0.1:63433_solr] -> [127.0.0.1:62104_solr]
   [junit4]   2> 159025 INFO  (jetty-closer-2150-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@6d084aab{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 159026 INFO  (jetty-closer-2150-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1703be7a{/solr,null,UNAVAILABLE}
   [junit4]   2> 159026 INFO  (jetty-closer-2150-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 159234 INFO  (jetty-closer-2150-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@51b70e57{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 159234 INFO  (jetty-closer-2150-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@67e245b6{/solr,null,UNAVAILABLE}
   [junit4]   2> 159234 INFO  (jetty-closer-2150-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 159333 INFO  (jetty-closer-2150-thread-3) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@417e58c0{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 159333 INFO  (jetty-closer-2150-thread-3) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@24bb2c4d{/solr,null,UNAVAILABLE}
   [junit4]   2> 159333 INFO  (jetty-closer-2150-thread-3) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 159440 INFO  (jetty-closer-2150-thread-4) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@71655b38{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 159441 INFO  (jetty-closer-2150-thread-4) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1827764b{/solr,null,UNAVAILABLE}
   [junit4]   2> 159441 INFO  (jetty-closer-2150-thread-4) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 159442 INFO  (TEST-TestContainerReqHandler.testSetClusterReqHandler-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 159649 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/aliases.json
   [junit4]   2> 	9	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	18	/solr/clusterprops.json
   [junit4]   2> 	9	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	30	/solr/live_nodes
   [junit4]   2> 	10	/solr/overseer/queue
   [junit4]   2> 	9	/solr/collections
   [junit4]   2> 
   [junit4]   2> 159656 INFO  (TEST-TestContainerReqHandler.testSetClusterReqHandler-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:49003
   [junit4]   2> 159656 INFO  (TEST-TestContainerReqHandler.testSetClusterReqHandler-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:49003
   [junit4]   2> 159656 INFO  (TEST-TestContainerReqHandler.testSetClusterReqHandler-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 49003
   [junit4] OK      3.06s J1 | TestContainerReqHandler.testSetClusterReqHandler
   [junit4]   2> 159657 INFO  (TEST-TestContainerReqHandler.testSetClusterReqHandler-seed#[37C8E5ACEF30D23D]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testSetClusterReqHandler
   [junit4]   2> 159658 INFO  (SUITE-TestContainerReqHandler-seed#[37C8E5ACEF30D23D]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 159658 INFO  (SUITE-TestContainerReqHandler-seed#[37C8E5ACEF30D23D]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:49003
   [junit4]   2> 159658 INFO  (SUITE-TestContainerReqHandler-seed#[37C8E5ACEF30D23D]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:49003
   [junit4]   2> 159658 INFO  (SUITE-TestContainerReqHandler-seed#[37C8E5ACEF30D23D]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 49003
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_37C8E5ACEF30D23D-003
   [junit4]   2> NOTE: test params are: codec=Lucene80, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@39071bf), locale=el, timezone=Asia/Urumqi
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_221 (64-bit)/cpus=3,threads=1,free=30439480,total=125054976
   [junit4]   2> NOTE: All tests run in this JVM: [TestContainerReqHandler, TestContainerReqHandler, TestContainerReqHandler]
   [junit4] Completed [5/5 (5!)] on J1 in 39.47s, 6 tests, 1 error <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 37C8E5ACEF30D23D]:
   [junit4]   - org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage
   [junit4]   - org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage
   [junit4]   - org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage
   [junit4]   - org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage
   [junit4]   - org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.79 ..   122.10 =   121.31s
   [junit4] JVM J1:     0.85 ..   161.05 =   160.20s
   [junit4] Execution time total: 2 minutes 41 seconds
   [junit4] Tests summary: 5 suites, 30 tests, 5 errors

BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/lucene/common-build.xml:1572: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/lucene/common-build.xml:1099: There were test failures: 5 suites, 30 tests, 5 errors [seed: 37C8E5ACEF30D23D]

Total time: 2 minutes 44 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.handler.TestContainerReqHandler
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
No credentials specified
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=f3c7bbf79e35dc7429e8ec439dacd09b9c969a54, workspace=/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #282
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-8.x-Solaris (64bit/jdk1.8.0) - Build # 286 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Solaris/286/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

5 tests failed.
FAILED:  org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage

Error Message:
Error from server at http://127.0.0.1:58772/solr: Underlying core creation failed while creating collection: globalCacheColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:58772/solr: Underlying core creation failed while creating collection: globalCacheColl
	at __randomizedtesting.SeedInfo.seed([998718D1B38989B5:55A24C4FB8DE3F56]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:656)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
	at org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage(TestContainerReqHandler.java:687)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage

Error Message:
Error from server at http://127.0.0.1:52136/solr: Underlying core creation failed while creating collection: globalCacheColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52136/solr: Underlying core creation failed while creating collection: globalCacheColl
	at __randomizedtesting.SeedInfo.seed([998718D1B38989B5:55A24C4FB8DE3F56]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:656)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
	at org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage(TestContainerReqHandler.java:687)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage

Error Message:
Error from server at http://127.0.0.1:44029/solr: Underlying core creation failed while creating collection: globalCacheColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:44029/solr: Underlying core creation failed while creating collection: globalCacheColl
	at __randomizedtesting.SeedInfo.seed([998718D1B38989B5:55A24C4FB8DE3F56]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:656)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
	at org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage(TestContainerReqHandler.java:687)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage

Error Message:
Error from server at http://127.0.0.1:43106/solr: Underlying core creation failed while creating collection: globalCacheColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43106/solr: Underlying core creation failed while creating collection: globalCacheColl
	at __randomizedtesting.SeedInfo.seed([998718D1B38989B5:55A24C4FB8DE3F56]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:656)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
	at org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage(TestContainerReqHandler.java:687)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage

Error Message:
Error from server at http://127.0.0.1:42649/solr: Underlying core creation failed while creating collection: globalCacheColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42649/solr: Underlying core creation failed while creating collection: globalCacheColl
	at __randomizedtesting.SeedInfo.seed([998718D1B38989B5:55A24C4FB8DE3F56]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:656)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
	at org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage(TestContainerReqHandler.java:687)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13474 lines...]
   [junit4] Suite: org.apache.solr.handler.TestContainerReqHandler
   [junit4]   2> 480351 INFO  (SUITE-TestContainerReqHandler-seed#[998718D1B38989B5]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 480352 INFO  (SUITE-TestContainerReqHandler-seed#[998718D1B38989B5]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_998718D1B38989B5-001/data-dir-36-001
   [junit4]   2> 480352 INFO  (SUITE-TestContainerReqHandler-seed#[998718D1B38989B5]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 480353 INFO  (SUITE-TestContainerReqHandler-seed#[998718D1B38989B5]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 480354 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testCacheLoadFromPackage
   [junit4]   2> 480360 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; jvm 1.8.0_221-b11
   [junit4]   2> 480375 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@3026ec84{HTTP/1.1,[http/1.1]}{0.0.0.0:61796}
   [junit4]   2> 480375 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.e.j.s.Server Started @480734ms
   [junit4]   2> 480375 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_998718D1B38989B5-001/tempDir-001
   [junit4]   2> 480375 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 480376 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 480376 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 480476 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.ZkTestServer start zk server on port:46607
   [junit4]   2> 480476 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:46607
   [junit4]   2> 480476 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:46607
   [junit4]   2> 480476 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 46607
   [junit4]   2> 480480 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 480484 INFO  (zkConnectionManagerCallback-4257-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 480484 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 480487 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 480489 INFO  (zkConnectionManagerCallback-4259-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 480489 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 480490 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 480491 INFO  (zkConnectionManagerCallback-4261-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 480491 INFO  (TEST-TestContainerReqHandler.testCacheLoadFromPackage-seed#[998718D1B38989B5]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 480595 WARN  (jetty-launcher-4262-thread-2) [     ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 480595 WARN  (jetty-launcher-4262-thread-1) [     ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 480595 WARN  (jetty-launcher-4262-thread-3) [     ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 480595 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 480595 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 480595 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 480595 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 480595 INFO  (jetty-launcher-4262-thread-2) [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; jvm 1.8.0_221-b11
   [junit4]   2> 480595 INFO  (jetty-launcher-4262-thread-3) [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; jvm 1.8.0_221-b11
   [junit4]   2> 480595 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 480595 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 480595 INFO  (jetty-launcher-4262-thread-1) [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; jvm 1.8.0_221-b11
   [junit4]   2> 480596 WARN  (jetty-launcher-4262-thread-4) [     ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 480596 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 480596 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 480596 INFO  (jetty-launcher-4262-thread-4) [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; jvm 1.8.0_221-b11
   [junit4]   2> 480596 INFO  (jetty-launcher-4262-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 480596 INFO  (jetty-launcher-4262-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 480596 INFO  (jetty-launcher-4262-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 480598 INFO  (jetty-launcher-4262-thread-3) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 480598 INFO  (jetty-launcher-4262-thread-3) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 480598 INFO  (jetty-launcher-4262-thread-3) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 480598 INFO  (jetty-launcher-4262-thread-3) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6d4d57b1{/solr,null,AVAILABLE}
   [junit4]   2> 480599 INFO  (jetty-launcher-4262-thread-4) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 480599 INFO  (jetty-launcher-4262-thread-4) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 480599 INFO  (jetty-launcher-4262-thread-4) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 480600 INFO  (jetty-launcher-4262-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@10264ee{/solr,null,AVAILABLE}
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-4) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@131f81ff{/solr,null,AVAILABLE}
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-3) [     ] o.e.j.s.AbstractConnector Started ServerConnector@43f4f63c{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:42649}
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-3) [     ] o.e.j.s.Server Started @480960ms
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42649}
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@54b9fb{/solr,null,AVAILABLE}
   [junit4]   2> 480601 ERROR (jetty-launcher-4262-thread-3) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.3.0
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 480601 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-08-25T01:03:59.582Z
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@506e09f2{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:59763}
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-2) [     ] o.e.j.s.Server Started @480961ms
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59763}
   [junit4]   2> 480602 ERROR (jetty-launcher-4262-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@152a7615{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:47564}
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-1) [     ] o.e.j.s.Server Started @480961ms
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.3.0
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=47564}
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-08-25T01:03:59.583Z
   [junit4]   2> 480602 ERROR (jetty-launcher-4262-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.3.0
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-08-25T01:03:59.583Z
   [junit4]   2> 480602 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 480603 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 480604 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 480605 INFO  (jetty-launcher-4262-thread-4) [     ] o.e.j.s.AbstractConnector Started ServerConnector@2576c23d{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:43983}
   [junit4]   2> 480605 INFO  (jetty-launcher-4262-thread-4) [     ] o.e.j.s.Server Started @480964ms
   [junit4]   2> 480605 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43983}
   [junit4]   2> 480605 INFO  (zkConnectionManagerCallback-4264-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 480605 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 480605 ERROR (jetty-launcher-4262-thread-4) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 480605 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 480605 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.3.0
   [junit4]   2> 480605 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 480605 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 480606 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-08-25T01:03:59.586Z
   [junit4]   2> 480606 INFO  (zkConnectionManagerCallback-4266-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 480606 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 480606 INFO  (zkConnectionManagerCallback-4268-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 480606 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 480606 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 480607 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 480607 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 480607 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 480608 INFO  (zkConnectionManagerCallback-4270-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 480608 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 480609 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 481414 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 481418 WARN  (jetty-launcher-4262-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@40a4520[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481418 WARN  (jetty-launcher-4262-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@40a4520[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481443 WARN  (jetty-launcher-4262-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1c50d71[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481443 WARN  (jetty-launcher-4262-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1c50d71[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481444 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46607/solr
   [junit4]   2> 481444 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481445 INFO  (zkConnectionManagerCallback-4280-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481445 INFO  (jetty-launcher-4262-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481534 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 481535 WARN  (jetty-launcher-4262-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2ae45092[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481535 WARN  (jetty-launcher-4262-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2ae45092[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481537 WARN  (jetty-launcher-4262-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@a7a099e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481537 WARN  (jetty-launcher-4262-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@a7a099e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481538 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46607/solr
   [junit4]   2> 481539 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481541 INFO  (zkConnectionManagerCallback-4286-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481541 INFO  (jetty-launcher-4262-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481547 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 481548 WARN  (jetty-launcher-4262-thread-4) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@626f9e87[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481548 WARN  (jetty-launcher-4262-thread-4) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@626f9e87[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481549 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481551 INFO  (zkConnectionManagerCallback-4290-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481551 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481551 WARN  (jetty-launcher-4262-thread-4) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5b157f13[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481551 WARN  (jetty-launcher-4262-thread-4) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5b157f13[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481552 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46607/solr
   [junit4]   2> 481554 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481555 INFO  (zkConnectionManagerCallback-4294-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481556 INFO  (jetty-launcher-4262-thread-4) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481574 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 481576 WARN  (jetty-launcher-4262-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@634f4856[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481576 WARN  (jetty-launcher-4262-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@634f4856[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481583 WARN  (jetty-launcher-4262-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7ebf9874[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481583 WARN  (jetty-launcher-4262-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7ebf9874[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 481584 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46607/solr
   [junit4]   2> 481585 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481587 INFO  (zkConnectionManagerCallback-4302-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481588 INFO  (jetty-launcher-4262-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481652 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481654 INFO  (zkConnectionManagerCallback-4304-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481654 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481693 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481698 INFO  (zkConnectionManagerCallback-4306-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481698 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481707 DEBUG (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 481708 DEBUG (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 481710 DEBUG (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> []
   [junit4]   2> 481711 DEBUG (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 481713 DEBUG (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 481714 DEBUG (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 481716 DEBUG (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> []
   [junit4]   2> 481718 DEBUG (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 481719 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59763_solr
   [junit4]   2> 481726 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.Overseer Overseer (id=72177578805559308-127.0.0.1:59763_solr-n_0000000000) starting
   [junit4]   2> 481733 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42649_solr
   [junit4]   2> 481735 DEBUG (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 481736 DEBUG (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 481737 INFO  (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 481737 DEBUG (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:42649_solr]
   [junit4]   2> 481737 INFO  (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 481737 DEBUG (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:42649_solr]
   [junit4]   2> 481739 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481740 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481741 INFO  (zkConnectionManagerCallback-4315-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481741 INFO  (zkConnectionManagerCallback-4320-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481741 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481741 DEBUG (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 481742 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481742 DEBUG (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 481743 DEBUG (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 481743 DEBUG (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 481744 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 481745 DEBUG (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:42649_solr]
   [junit4]   2> 481745 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 481745 DEBUG (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:42649_solr]
   [junit4]   2> 481746 DEBUG (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 481746 DEBUG (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 481747 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46607/solr ready
   [junit4]   2> 481747 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46607/solr ready
   [junit4]   2> 481747 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.PackageManager clusterprops.json changed , version -1
   [junit4]   2> 481749 INFO  (OverseerStateUpdate-72177578805559308-127.0.0.1:59763_solr-n_0000000000) [n:127.0.0.1:59763_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:59763_solr
   [junit4]   2> 481749 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:59763_solr as DOWN
   [junit4]   2> 481753 DEBUG (OverseerStateUpdate-72177578805559308-127.0.0.1:59763_solr-n_0000000000) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr] -> [127.0.0.1:42649_solr]
   [junit4]   2> 481753 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 481753 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59763_solr
   [junit4]   2> 481754 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481754 DEBUG (OverseerStateUpdate-72177578805559308-127.0.0.1:59763_solr-n_0000000000) [n:127.0.0.1:59763_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 481756 DEBUG (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 481758 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.PackageManager clusterprops.json changed , version -1
   [junit4]   2> 481758 DEBUG (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 481760 INFO  (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 481760 DEBUG (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481760 DEBUG (zkCallback-4314-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 481760 INFO  (zkCallback-4314-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 481760 INFO  (zkConnectionManagerCallback-4322-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481761 INFO  (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 481760 DEBUG (zkCallback-4314-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481761 DEBUG (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481761 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481768 DEBUG (zkCallback-4319-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 481773 DEBUG (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 481773 DEBUG (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 481775 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 481775 DEBUG (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:42649_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481777 DEBUG (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 481777 INFO  (zkCallback-4319-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 481778 DEBUG (zkCallback-4319-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481785 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:43983_solr as DOWN
   [junit4]   2> 481787 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 481787 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43983_solr
   [junit4]   2> 481788 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 481788 DEBUG (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 481789 INFO  (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 481790 DEBUG (zkCallback-4314-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 481790 DEBUG (zkCallback-4321-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 481790 DEBUG (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481791 INFO  (zkCallback-4321-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 481791 DEBUG (zkCallback-4321-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481791 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 481791 INFO  (zkCallback-4314-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 481791 DEBUG (zkCallback-4314-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481792 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481794 INFO  (zkConnectionManagerCallback-4331-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481794 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481794 DEBUG (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 481795 DEBUG (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 481795 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 481795 DEBUG (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481796 DEBUG (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 481797 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46607/solr ready
   [junit4]   2> 481797 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.c.PackageManager clusterprops.json changed , version -1
   [junit4]   2> 481800 DEBUG (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 481800 DEBUG (zkCallback-4319-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 481805 DEBUG (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 481806 DEBUG (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 481806 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 481806 DEBUG (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481807 DEBUG (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 481808 INFO  (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 481808 DEBUG (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481812 INFO  (zkCallback-4319-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 481818 DEBUG (zkCallback-4319-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481818 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:47564_solr as DOWN
   [junit4]   2> 481820 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 481820 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47564_solr
   [junit4]   2> 481821 DEBUG (zkCallback-4314-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 481822 DEBUG (zkCallback-4321-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 481822 DEBUG (zkCallback-4289-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 481823 DEBUG (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 481823 DEBUG (zkCallback-4330-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 481823 INFO  (zkCallback-4314-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 481823 DEBUG (zkCallback-4314-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:47564_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481824 INFO  (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 481824 DEBUG (zkCallback-4303-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:47564_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481824 INFO  (zkCallback-4321-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 481824 DEBUG (zkCallback-4321-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:47564_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481824 INFO  (zkCallback-4289-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 481824 DEBUG (zkCallback-4289-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:47564_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481824 INFO  (zkCallback-4330-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 481824 DEBUG (zkCallback-4330-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:47564_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481825 DEBUG (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 481825 INFO  (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 481825 DEBUG (zkCallback-4305-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:47564_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481825 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 481828 DEBUG (zkCallback-4319-thread-1) [     ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 481829 INFO  (zkCallback-4319-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 481829 DEBUG (zkCallback-4319-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:59763_solr] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:47564_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481830 INFO  (zkConnectionManagerCallback-4336-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 481830 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 481830 DEBUG (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 481831 DEBUG (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 481832 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 481832 DEBUG (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [] -> [127.0.0.1:42649_solr, 127.0.0.1:43983_solr, 127.0.0.1:47564_solr, 127.0.0.1:59763_solr]
   [junit4]   2> 481832 DEBUG (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.c.ZkStateReader clusterStateSet: legacy [0] interesting [0] watched [0] lazy [0] total [0]
   [junit4]   2> 481833 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46607/solr ready
   [junit4]   2> 481833 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.PackageManager clusterprops.json changed , version -1
   [junit4]   2> 481838 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59763.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e76ad6
   [junit4]   2> 481842 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 481844 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59763.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e76ad6
   [junit4]   2> 481844 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59763.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e76ad6
   [junit4]   2> 481845 INFO  (jetty-launcher-4262-thread-2) [n:127.0.0.1:59763_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_998718D1B38989B5-001/tempDir-001/node1/.
   [junit4]   2> 481848 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42649.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e76ad6
   [junit4]   2> 481859 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 481889 INFO  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43983.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e76ad6
   [junit4]   2> 481921 WARN  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.m.r.j.JmxMetricsReporter Unable to register gauge
   [junit4]   2>           => javax.management.InstanceNotFoundException: solr_42649:dom1=solr,dom2=jvm,name0=memory,name1=pools,name2=Code-Cache,name=max
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095)
   [junit4]   2> javax.management.InstanceNotFoundException: solr_42649:dom1=solr,dom2=jvm,name0=memory,name1=pools,name2=Code-Cache,name=max
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095) ~[?:1.8.0_221]
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:427) ~[?:1.8.0_221]
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415) ~[?:1.8.0_221]
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546) ~[?:1.8.0_221]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.registerMBean(JmxMetricsReporter.java:531) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.onGaugeAdded(JmxMetricsReporter.java:569) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.lambda$start$0(JmxMetricsReporter.java:742) ~[java/:?]
   [junit4]   2> 	at java.util.HashMap.forEach(HashMap.java:1289) ~[?:1.8.0_221]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.start(JmxMetricsReporter.java:732) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.SolrJmxReporter.doInit(SolrJmxReporter.java:109) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricReporter.init(SolrMetricReporter.java:70) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporter(SolrMetricManager.java:986) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporters(SolrMetricManager.java:912) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:671) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:136) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:750) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_221]
   [junit4]   2> 	at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742) ~[?:1.8.0_221]
   [junit4]   2> 	at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742) ~[?:1.8.0_221]
   [junit4]   2> 	at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) ~[?:1.8.0_221]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:744) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1449) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1513) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1158) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:995) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:468) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:384) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) ~[jetty-util-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) ~[jetty-util-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.retryOnPortBindFailure(JettySolrRunner.java:558) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:497) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:465) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:469) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:300) ~[java/:?]
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_221]
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210) ~[java/:?]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_221]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_221]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_221]
   [junit4]   2> 481923 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47564.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e76ad6
   [junit4]   2> 481944 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42649.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e76ad6
   [junit4]   2> 481944 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42649.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e76ad6
   [junit4]   2> 481957 INFO  (jetty-launcher-4262-thread-3) [n:127.0.0.1:42649_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_998718D1B38989B5-001/tempDir-001/node3/.
   [junit4]   2> 481964 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47564.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e76ad6
   [junit4]   2> 481964 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47564.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e76ad6
   [junit4]   2> 481965 INFO  (jetty-launcher-4262-thread-1) [n:127.0.0.1:47564_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.TestContainerReqHandler_998718D1B38989B5-001/tempDir-001/node2/.
   [junit4]   2> 481968 WARN  (jetty-launcher-4262-thread-4) [n:127.0.0.1:43983_solr     ] o.a.s.m.r.j.JmxMetricsReporter Unable to register gauge
   [junit4]   2>           => javax.management.InstanceNotFoundException: solr_43983:dom1=solr,dom2=jvm,name0=threads,name1=timed_waiting,name=count
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095)
   [junit4]   2> javax.management.InstanceNotFoundException: solr_43983:dom1=solr,dom2=jvm,name0=threads,name1=timed_waiting,name=count
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095) ~[?:1.8.0_221]
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:427) ~[?:1.8.0_221]
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415) ~[?:1.8.0_221]
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546) ~[?:1.8.0_221]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.registerMBean(JmxMetricsReporter.java:531) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.onGaugeAdded(JmxMetricsReporter.java:569) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.lambda$start$0(JmxMetricsReporter.java:742) ~[java/:?]
   [junit4]   2> 	at java.util.HashMap.forEach(HashMap.java:1289) ~[?:1.8.0_221]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.start(JmxMetricsReporter.java:732) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.SolrJmxReporter.doInit(SolrJmxReporter.java:109) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricReporter.init(SolrMetricReporter.java:70) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporter(SolrMetricManager.java:986) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporters(SolrMetricManager.java:912) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:671) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:136) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:750) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_221]
   [junit4]   2> 	at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742) ~[?:1.8.0_221]
   [junit4]   2> 	at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742) ~[?:1.8.0_221]
   [junit4]   2> 	at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) ~[?:1.8.0_221]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:744) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1449) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1513) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1158) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:995) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:468) ~[jetty-servlet-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:384) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) ~[jetty-util-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) ~[jetty-util-9.4.19.v20190610.jar:9.4.19.v20190610]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.retryOnPortBindFailure(JettySolrRunner.java:558) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:497) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:465) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.start

[...truncated too long message...]

r Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 172418 INFO  (jetty-closer-2143-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 172418 INFO  (jetty-closer-2143-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@44fe7a71: rootName = solr_60967, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@419273a
   [junit4]   2> 172418 INFO  (jetty-closer-2143-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 172421 INFO  (closeThreadPool-2159-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72177936402284554-127.0.0.1:60967_solr-n_0000000000) closing
   [junit4]   2> 172421 INFO  (OverseerAutoScalingTriggerThread-72177936402284554-127.0.0.1:60967_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 172424 INFO  (OverseerStateUpdate-72177936402284554-127.0.0.1:60967_solr-n_0000000000) [n:127.0.0.1:60967_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60967_solr
   [junit4]   2> 172429 INFO  (closeThreadPool-2159-thread-2) [     ] o.a.s.c.Overseer Overseer (id=72177936402284554-127.0.0.1:60967_solr-n_0000000000) closing
   [junit4]   2> 172525 INFO  (jetty-closer-2143-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@6d7bfc16{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 172526 INFO  (jetty-closer-2143-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@46ad4517{/solr,null,UNAVAILABLE}
   [junit4]   2> 172527 INFO  (jetty-closer-2143-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 172623 INFO  (zkCallback-2116-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (2)
   [junit4]   2> 172623 DEBUG (zkCallback-2116-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... [127.0.0.1:41458_solr, 127.0.0.1:44626_solr, 127.0.0.1:58951_solr, 127.0.0.1:60967_solr] -> [127.0.0.1:41458_solr, 127.0.0.1:44626_solr]
   [junit4]   2> 172823 INFO  (jetty-closer-2143-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72177936402284554-127.0.0.1:60967_solr-n_0000000000) closing
   [junit4]   2> 172827 INFO  (jetty-closer-2143-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@3f425199{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 172828 INFO  (jetty-closer-2143-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@64885e59{/solr,null,UNAVAILABLE}
   [junit4]   2> 172828 INFO  (jetty-closer-2143-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 172854 INFO  (jetty-closer-2143-thread-3) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@50617695{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 172855 INFO  (jetty-closer-2143-thread-3) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@8df955e{/solr,null,UNAVAILABLE}
   [junit4]   2> 172855 INFO  (jetty-closer-2143-thread-3) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 172930 INFO  (jetty-closer-2143-thread-4) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@29285870{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 172935 INFO  (jetty-closer-2143-thread-4) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7473de2e{/solr,null,UNAVAILABLE}
   [junit4]   2> 172935 INFO  (jetty-closer-2143-thread-4) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 172938 INFO  (TEST-TestContainerReqHandler.testRuntimeLibWithSig512-seed#[998718D1B38989B5]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 173148 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/aliases.json
   [junit4]   2> 	9	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	27	/solr/clusterprops.json
   [junit4]   2> 	9	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	33	/solr/live_nodes
   [junit4]   2> 	11	/solr/overseer/queue
   [junit4]   2> 	9	/solr/collections
   [junit4]   2> 
   [junit4]   2> 173151 INFO  (TEST-TestContainerReqHandler.testRuntimeLibWithSig512-seed#[998718D1B38989B5]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:34549
   [junit4]   2> 173151 INFO  (TEST-TestContainerReqHandler.testRuntimeLibWithSig512-seed#[998718D1B38989B5]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:34549
   [junit4]   2> 173151 INFO  (TEST-TestContainerReqHandler.testRuntimeLibWithSig512-seed#[998718D1B38989B5]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 34549
   [junit4]   2> 173152 INFO  (TEST-TestContainerReqHandler.testRuntimeLibWithSig512-seed#[998718D1B38989B5]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testRuntimeLibWithSig512
   [junit4] OK      4.69s J0 | TestContainerReqHandler.testRuntimeLibWithSig512
   [junit4]   2> 173153 INFO  (SUITE-TestContainerReqHandler-seed#[998718D1B38989B5]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 173153 INFO  (SUITE-TestContainerReqHandler-seed#[998718D1B38989B5]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:34549
   [junit4]   2> 173153 INFO  (SUITE-TestContainerReqHandler-seed#[998718D1B38989B5]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:34549
   [junit4]   2> 173153 INFO  (SUITE-TestContainerReqHandler-seed#[998718D1B38989B5]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 34549
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.TestContainerReqHandler_998718D1B38989B5-003
   [junit4]   2> Aug 25, 2019 2:34:58 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): {}, docValues:{}, maxPointsInLeafNode=1290, maxMBSortInHeap=7.356467571494072, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@5a0aaca2), locale=es-AR, timezone=Indian/Mahe
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_221 (64-bit)/cpus=3,threads=1,free=50868632,total=105074688
   [junit4]   2> NOTE: All tests run in this JVM: [TestContainerReqHandler, TestContainerReqHandler, TestContainerReqHandler]
   [junit4] Completed [5/5 (5!)] on J0 in 47.40s, 6 tests, 1 error <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 998718D1B38989B5]:
   [junit4]   - org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage
   [junit4]   - org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage
   [junit4]   - org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage
   [junit4]   - org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage
   [junit4]   - org.apache.solr.handler.TestContainerReqHandler.testCacheLoadFromPackage
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     1.43 ..   175.05 =   173.62s
   [junit4] JVM J1:     1.42 ..   134.44 =   133.02s
   [junit4] Execution time total: 2 minutes 55 seconds
   [junit4] Tests summary: 5 suites, 30 tests, 5 errors

BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/lucene/common-build.xml:1572: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/lucene/common-build.xml:1099: There were test failures: 5 suites, 30 tests, 5 errors [seed: 998718D1B38989B5]

Total time: 2 minutes 59 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.handler.TestContainerReqHandler
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
No credentials specified
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=cac4d012e1a8db4b3033bb902c92222fa932f10f, workspace=/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #284
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-8.x-Solaris (64bit/jdk1.8.0) - Build # 284 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Solaris/284/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider

Error Message:
Error starting up MiniSolrCloudCluster

Stack Trace:
java.lang.Exception: Error starting up MiniSolrCloudCluster
	at __randomizedtesting.SeedInfo.seed([F14AD537D4831DD8]:0)
	at org.apache.solr.cloud.MiniSolrCloudCluster.checkForExceptions(MiniSolrCloudCluster.java:654)
	at org.apache.solr.cloud.MiniSolrCloudCluster.<init>(MiniSolrCloudCluster.java:306)
	at org.apache.solr.cloud.SolrCloudTestCase$Builder.build(SolrCloudTestCase.java:222)
	at org.apache.solr.cloud.SolrCloudTestCase$Builder.configure(SolrCloudTestCase.java:214)
	at org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider.setupCluster(TestSimClusterStateProvider.java:80)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:878)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
	Suppressed: java.lang.RuntimeException: Jetty/Solr unresponsive
		at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:507)
		at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:465)
		at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:469)
		at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:300)
		at java.util.concurrent.FutureTask.run(FutureTask.java:266)
		at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
		... 1 more
	Suppressed: java.lang.RuntimeException: Jetty/Solr unresponsive
		at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:507)
		at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:465)
		at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:469)
		at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:300)
		at java.util.concurrent.FutureTask.run(FutureTask.java:266)
		at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
		... 1 more
	Suppressed: java.lang.RuntimeException: Jetty/Solr unresponsive
		at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:507)
		at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:465)
		at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:469)
		at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:300)
		at java.util.concurrent.FutureTask.run(FutureTask.java:266)
		at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
		... 1 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider

Error Message:
28 threads leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider:     1) Thread[id=4625, name=qtp890872507-4625, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=4639, name=qtp1804770979-4639, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)    3) Thread[id=4624, name=qtp890872507-4624, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)    4) Thread[id=4626, name=qtp890872507-4626, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)    5) Thread[id=4628, name=Session-HouseKeeper-33c98733, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    6) Thread[id=4611, name=qtp440766420-4611, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]         at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)         at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)         at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at org.eclipse.jetty.io.ManagedSelector$$Lambda$38/10824030.run(Unknown Source)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.lang.Thread.run(Thread.java:748)    7) Thread[id=4615, name=qtp440766420-4615, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)    8) Thread[id=4621, name=qtp890872507-4621-acceptor-0@1d002c26-ServerConnector@7ae35053{SSL,[ssl, http/1.1]}{127.0.0.1:55700}, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)         at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.lang.Thread.run(Thread.java:748)    9) Thread[id=4633, name=Connector-Scheduler-7ae35053, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   10) Thread[id=4622, name=qtp890872507-4622, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   11) Thread[id=4634, name=qtp1804770979-4634, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   12) Thread[id=4618, name=qtp440766420-4618, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   13) Thread[id=4627, name=qtp890872507-4627, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   14) Thread[id=4614, name=qtp440766420-4614, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   15) Thread[id=4635, name=qtp1804770979-4635, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]         at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)         at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)         at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at org.eclipse.jetty.io.ManagedSelector$$Lambda$38/10824030.run(Unknown Source)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.lang.Thread.run(Thread.java:748)   16) Thread[id=4623, name=qtp890872507-4623, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   17) Thread[id=4642, name=Session-HouseKeeper-32e8e005, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   18) Thread[id=4619, name=Session-HouseKeeper-521d3b8, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   19) Thread[id=4640, name=qtp1804770979-4640, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   20) Thread[id=4641, name=qtp1804770979-4641, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   21) Thread[id=4636, name=qtp1804770979-4636-acceptor-0@34d3b0a6-ServerConnector@2468779a{SSL,[ssl, http/1.1]}{127.0.0.1:60474}, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)         at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.lang.Thread.run(Thread.java:748)   22) Thread[id=4617, name=qtp440766420-4617, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   23) Thread[id=4620, name=qtp890872507-4620, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]         at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)         at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)         at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at org.eclipse.jetty.io.ManagedSelector$$Lambda$38/10824030.run(Unknown Source)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.lang.Thread.run(Thread.java:748)   24) Thread[id=4612, name=qtp440766420-4612-acceptor-0@10cb60a3-ServerConnector@10bde4a4{SSL,[ssl, http/1.1]}{127.0.0.1:60745}, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)         at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.lang.Thread.run(Thread.java:748)   25) Thread[id=4613, name=qtp440766420-4613, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   26) Thread[id=4637, name=qtp1804770979-4637, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   27) Thread[id=4616, name=qtp440766420-4616, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   28) Thread[id=4638, name=qtp1804770979-4638, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 28 threads leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider: 
   1) Thread[id=4625, name=qtp890872507-4625, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=4639, name=qtp1804770979-4639, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
   3) Thread[id=4624, name=qtp890872507-4624, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
   4) Thread[id=4626, name=qtp890872507-4626, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
   5) Thread[id=4628, name=Session-HouseKeeper-33c98733, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   6) Thread[id=4611, name=qtp440766420-4611, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]
        at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
        at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
        at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)
        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at org.eclipse.jetty.io.ManagedSelector$$Lambda$38/10824030.run(Unknown Source)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.lang.Thread.run(Thread.java:748)
   7) Thread[id=4615, name=qtp440766420-4615, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
   8) Thread[id=4621, name=qtp890872507-4621-acceptor-0@1d002c26-ServerConnector@7ae35053{SSL,[ssl, http/1.1]}{127.0.0.1:55700}, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]
        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
        at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.lang.Thread.run(Thread.java:748)
   9) Thread[id=4633, name=Connector-Scheduler-7ae35053, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  10) Thread[id=4622, name=qtp890872507-4622, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  11) Thread[id=4634, name=qtp1804770979-4634, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  12) Thread[id=4618, name=qtp440766420-4618, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  13) Thread[id=4627, name=qtp890872507-4627, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  14) Thread[id=4614, name=qtp440766420-4614, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  15) Thread[id=4635, name=qtp1804770979-4635, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]
        at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
        at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
        at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)
        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at org.eclipse.jetty.io.ManagedSelector$$Lambda$38/10824030.run(Unknown Source)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.lang.Thread.run(Thread.java:748)
  16) Thread[id=4623, name=qtp890872507-4623, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  17) Thread[id=4642, name=Session-HouseKeeper-32e8e005, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  18) Thread[id=4619, name=Session-HouseKeeper-521d3b8, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  19) Thread[id=4640, name=qtp1804770979-4640, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  20) Thread[id=4641, name=qtp1804770979-4641, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  21) Thread[id=4636, name=qtp1804770979-4636-acceptor-0@34d3b0a6-ServerConnector@2468779a{SSL,[ssl, http/1.1]}{127.0.0.1:60474}, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]
        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
        at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.lang.Thread.run(Thread.java:748)
  22) Thread[id=4617, name=qtp440766420-4617, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  23) Thread[id=4620, name=qtp890872507-4620, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]
        at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
        at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
        at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)
        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at org.eclipse.jetty.io.ManagedSelector$$Lambda$38/10824030.run(Unknown Source)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.lang.Thread.run(Thread.java:748)
  24) Thread[id=4612, name=qtp440766420-4612-acceptor-0@10cb60a3-ServerConnector@10bde4a4{SSL,[ssl, http/1.1]}{127.0.0.1:60745}, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]
        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
        at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.lang.Thread.run(Thread.java:748)
  25) Thread[id=4613, name=qtp440766420-4613, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  26) Thread[id=4637, name=qtp1804770979-4637, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  27) Thread[id=4616, name=qtp440766420-4616, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  28) Thread[id=4638, name=qtp1804770979-4638, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([F14AD537D4831DD8]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=4625, name=qtp890872507-4625, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=4639, name=qtp1804770979-4639, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)    3) Thread[id=4624, name=qtp890872507-4624, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)    4) Thread[id=4626, name=qtp890872507-4626, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)    5) Thread[id=4628, name=Session-HouseKeeper-33c98733, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    6) Thread[id=4611, name=qtp440766420-4611, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]         at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)         at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)         at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at org.eclipse.jetty.io.ManagedSelector$$Lambda$38/10824030.run(Unknown Source)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.lang.Thread.run(Thread.java:748)    7) Thread[id=4615, name=qtp440766420-4615, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)    8) Thread[id=4621, name=qtp890872507-4621, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)    9) Thread[id=4633, name=Connector-Scheduler-7ae35053, state=WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   10) Thread[id=4622, name=qtp890872507-4622, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   11) Thread[id=4634, name=qtp1804770979-4634, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   12) Thread[id=4618, name=qtp440766420-4618, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   13) Thread[id=4627, name=qtp890872507-4627, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   14) Thread[id=4614, name=qtp440766420-4614, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   15) Thread[id=4635, name=qtp1804770979-4635, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]         at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)         at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)         at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at org.eclipse.jetty.io.ManagedSelector$$Lambda$38/10824030.run(Unknown Source)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.lang.Thread.run(Thread.java:748)   16) Thread[id=4623, name=qtp890872507-4623, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   17) Thread[id=4642, name=Session-HouseKeeper-32e8e005, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   18) Thread[id=4619, name=Session-HouseKeeper-521d3b8, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   19) Thread[id=4640, name=qtp1804770979-4640, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   20) Thread[id=4641, name=qtp1804770979-4641, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   21) Thread[id=4636, name=qtp1804770979-4636, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   22) Thread[id=4617, name=qtp440766420-4617, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   23) Thread[id=4620, name=qtp890872507-4620, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]         at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)         at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)         at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at org.eclipse.jetty.io.ManagedSelector$$Lambda$38/10824030.run(Unknown Source)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.lang.Thread.run(Thread.java:748)   24) Thread[id=4612, name=qtp440766420-4612, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   25) Thread[id=4613, name=qtp440766420-4613, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   26) Thread[id=4637, name=qtp1804770979-4637, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   27) Thread[id=4616, name=qtp440766420-4616, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)   28) Thread[id=4638, name=qtp1804770979-4638, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=4625, name=qtp890872507-4625, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=4639, name=qtp1804770979-4639, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
   3) Thread[id=4624, name=qtp890872507-4624, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
   4) Thread[id=4626, name=qtp890872507-4626, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
   5) Thread[id=4628, name=Session-HouseKeeper-33c98733, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   6) Thread[id=4611, name=qtp440766420-4611, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]
        at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
        at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
        at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)
        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at org.eclipse.jetty.io.ManagedSelector$$Lambda$38/10824030.run(Unknown Source)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.lang.Thread.run(Thread.java:748)
   7) Thread[id=4615, name=qtp440766420-4615, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
   8) Thread[id=4621, name=qtp890872507-4621, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
   9) Thread[id=4633, name=Connector-Scheduler-7ae35053, state=WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  10) Thread[id=4622, name=qtp890872507-4622, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  11) Thread[id=4634, name=qtp1804770979-4634, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  12) Thread[id=4618, name=qtp440766420-4618, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  13) Thread[id=4627, name=qtp890872507-4627, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  14) Thread[id=4614, name=qtp440766420-4614, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  15) Thread[id=4635, name=qtp1804770979-4635, state=RUNNABLE, group=TGRP-TestSimClusterStateProvider]
        at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
        at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
        at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)
        at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at org.eclipse.jetty.io.ManagedSelector$$Lambda$38/10824030.run(Unknown Source)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.lang.Thread.run(Thread.java:748)
  16) Thread[id=4623, name=qtp890872507-4623, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.lang.Thread.run(Thread.java:748)
  17) Thread[id=4642, name=Session-HouseKeeper-32e8e005, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
  18) Thread[id=4619, name=Session-HouseKeeper-521d3b8, state=TIMED_WAITING, group=TGRP-TestSimClusterStateProvider]
        at sun.misc.Unsafe.park(Native Method)
   

[...truncated too long message...]

ests.class="*.TestSimClusterStateProvider" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=F14AD537D4831DD8 -Dtests.slow=true -Dtests.locale=ko -Dtests.timezone=Asia/Yakutsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8
Buildfile: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/build.xml

-clover.disable:

ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/lucene/top-level-ivy-settings.xml

install-junit4-taskdef:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.codehaus.groovy#groovy-all;2.4.16 in public
[ivy:cachepath] :: resolution report :: resolve 14ms :: artifacts dl 0ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
	---------------------------------------------------------------------

-init-totals:

-test:
    [mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: F14AD537D4831DD8
    [mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/temp
   [junit4] <JUnit4> says ahoj! Master seed: F14AD537D4831DD8
   [junit4] Executing 5 suites with 2 JVMs.
   [junit4] 
   [junit4] Started J0 PID(13229@serv1-vm3).
   [junit4] Started J1 PID(13230@serv1-vm3).
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider
   [junit4] OK      0.06s J0 | TestSimClusterStateProvider.testAutoScalingConfig
   [junit4] OK      1.92s J0 | TestSimClusterStateProvider.testAddRemoveNode
   [junit4] Completed [1/5] on J0 in 17.46s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider
   [junit4] OK      0.10s J1 | TestSimClusterStateProvider.testAutoScalingConfig
   [junit4] OK      2.09s J1 | TestSimClusterStateProvider.testAddRemoveNode
   [junit4] Completed [2/5] on J1 in 18.22s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider
   [junit4] OK      0.05s J0 | TestSimClusterStateProvider.testAutoScalingConfig
   [junit4] OK      1.82s J0 | TestSimClusterStateProvider.testAddRemoveNode
   [junit4] Completed [3/5] on J0 in 8.82s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider
   [junit4] OK      0.06s J1 | TestSimClusterStateProvider.testAutoScalingConfig
   [junit4] OK      1.93s J1 | TestSimClusterStateProvider.testAddRemoveNode
   [junit4] Completed [4/5] on J1 in 9.06s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider
   [junit4] OK      0.08s J0 | TestSimClusterStateProvider.testAutoScalingConfig
   [junit4] OK      1.21s J0 | TestSimClusterStateProvider.testAddRemoveNode
   [junit4] Completed [5/5] on J0 in 7.80s, 2 tests
   [junit4] 
   [junit4] JVM J0:     0.71 ..    35.92 =    35.21s
   [junit4] JVM J1:     0.72 ..    28.71 =    27.99s
   [junit4] Execution time total: 35 seconds
   [junit4] Tests summary: 5 suites, 10 tests
   [junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp])
   [junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp])
     [echo] 5 slowest tests:
[junit4:tophints] 138.72s | org.apache.solr.cloud.CollectionsAPISolrJTest
[junit4:tophints]  79.16s | org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4:tophints]  64.38s | org.apache.solr.cloud.PeerSyncReplicationTest
[junit4:tophints]  62.99s | org.apache.solr.cloud.TestCloudSearcherWarming
[junit4:tophints]  60.74s | org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest

-check-totals:

test-nocompile:

BUILD SUCCESSFUL
Total time: 38 seconds
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestSimClusterStateProvider
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
	at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2805)
	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2684)
	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2665)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3052)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to Solaris VBOX
		at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1743)
		at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
		at hudson.remoting.Channel.call(Channel.java:957)
		at hudson.FilePath.act(FilePath.java:1072)
		at hudson.FilePath.act(FilePath.java:1061)
		at hudson.FilePath.validateAntFileMask(FilePath.java:2663)
		at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:248)
		at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:79)
		at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
		at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:741)
		at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
		at hudson.model.Build$BuildExecution.post2(Build.java:186)
		at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
		at hudson.model.Run.execute(Run.java:1840)
		at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
		at hudson.model.ResourceController.execute(ResourceController.java:97)
		at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3054)
	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
	at hudson.remoting.Request$2.run(Request.java:369)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
	at hudson.FilePath.act(FilePath.java:1074)
	at hudson.FilePath.act(FilePath.java:1061)
	at hudson.FilePath.validateAntFileMask(FilePath.java:2663)
	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:248)
	at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:79)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:741)
	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
	at hudson.model.Build$BuildExecution.post2(Build.java:186)
	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
	at hudson.model.Run.execute(Run.java:1840)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
No credentials specified
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=cac4d012e1a8db4b3033bb902c92222fa932f10f, workspace=/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #283
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2