You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/03/14 05:44:00 UTC

[JENKINS-EA] Lucene-Solr-BadApples-7.x-Linux (64bit/jdk-10-ea+43) - Build # 8 - Still Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/8/
Java: 64bit/jdk-10-ea+43 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

9 tests failed.
FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart

Error Message:
IOException occured when talking to server at: http://127.0.0.1:40995/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:40995/solr/collection1
	at __randomizedtesting.SeedInfo.seed([46C32BA68EC3222E:9E34EF422518E072]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
	at org.apache.solr.handler.TestReplicationHandler.index(TestReplicationHandler.java:180)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart(TestReplicationHandler.java:643)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:40995 failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 46 more


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart

Error Message:
IOException occured when talking to server at: http://127.0.0.1:44147/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:44147/solr/collection1
	at __randomizedtesting.SeedInfo.seed([46C32BA68EC3222E:9E34EF422518E072]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
	at org.apache.solr.handler.TestReplicationHandler.index(TestReplicationHandler.java:180)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart(TestReplicationHandler.java:643)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:44147 failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 46 more


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart

Error Message:
IOException occured when talking to server at: http://127.0.0.1:43569/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:43569/solr/collection1
	at __randomizedtesting.SeedInfo.seed([46C32BA68EC3222E:9E34EF422518E072]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
	at org.apache.solr.handler.TestReplicationHandler.index(TestReplicationHandler.java:180)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart(TestReplicationHandler.java:643)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:43569 failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 46 more


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart

Error Message:
IOException occured when talking to server at: http://127.0.0.1:41373/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:41373/solr/collection1
	at __randomizedtesting.SeedInfo.seed([46C32BA68EC3222E:9E34EF422518E072]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
	at org.apache.solr.handler.TestReplicationHandler.index(TestReplicationHandler.java:180)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart(TestReplicationHandler.java:643)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:41373 failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 46 more


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart

Error Message:
IOException occured when talking to server at: http://127.0.0.1:36529/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:36529/solr/collection1
	at __randomizedtesting.SeedInfo.seed([46C32BA68EC3222E:9E34EF422518E072]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
	at org.apache.solr.handler.TestReplicationHandler.index(TestReplicationHandler.java:180)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart(TestReplicationHandler.java:643)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:36529 failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 46 more


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([1A45AB1CEE33758A:EBE4D94CDB88BF18]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([1A45AB1CEE33758A:EBE4D94CDB88BF18]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([1A45AB1CEE33758A:EBE4D94CDB88BF18]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([1A45AB1CEE33758A:EBE4D94CDB88BF18]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1776 lines...]
   [junit4] JVM J2: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/core/test/temp/junit4-J2-20180314_041629_03214077217466462730260.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] codec: Asserting, pf: BloomFilter, dvf: Direct
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/core/test/temp/junit4-J2-20180314_041629_0321408275693512940968.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/core/test/temp/junit4-J1-20180314_041629_03214506918347136057019.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/core/test/temp/junit4-J0-20180314_041629_0326010074847788300692.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 295 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J2-20180314_042313_1276799607462595029857.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J1-20180314_042313_12714841871711601069013.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J0-20180314_042313_12710199127702923000529.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1062 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20180314_042424_30913276080348879794384.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20180314_042424_30916557198437356207257.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20180314_042424_309865550536936174338.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 235 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20180314_042605_3985228763540182150717.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20180314_042605_3982220089104328368805.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20180314_042605_3984263942411774914084.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 256 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20180314_042621_4055488315356858331256.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20180314_042621_40515252540975295503897.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20180314_042621_40515709477003843225197.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 162 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20180314_042647_3579894493500412005735.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20180314_042647_3579954855181989554777.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20180314_042647_35718247271153448639942.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 166 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J2-20180314_042651_2263197346981093705129.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J0-20180314_042651_22614656050872842429024.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J1-20180314_042651_22616526773614353314963.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 176 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20180314_042654_3663724856588664601182.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20180314_042654_36617515797598750827497.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20180314_042654_3666391503115248913827.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 161 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20180314_042703_81315447909570053931164.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20180314_042703_81310340013713145013176.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 162 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20180314_042711_54110901052584466000503.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20180314_042711_5416505038850873028808.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20180314_042711_54110055761885596508523.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 177 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20180314_042714_33617377827894903342940.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 198 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20180314_042723_8479834415933041732710.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 24 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20180314_042723_84715552328340713401393.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20180314_042723_84717272560940767398800.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 1403 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J1-20180314_042915_85239553970477897000.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J2-20180314_042915_8525321118866734381206.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J0-20180314_042915_8527668573738462723652.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 253 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/classification/test/temp/junit4-J1-20180314_042924_78016476091400468813676.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/classification/test/temp/junit4-J2-20180314_042924_78112739234480173321445.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/classification/test/temp/junit4-J0-20180314_042924_7784248369366784641056.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 247 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/codecs/test/temp/junit4-J1-20180314_042935_9188700089266784171908.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 10 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/codecs/test/temp/junit4-J2-20180314_042935_9187593970215762660287.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 12 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/codecs/test/temp/junit4-J0-20180314_042935_91817872054992319008771.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 236 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/demo/test/temp/junit4-J1-20180314_043152_6115214579950665996962.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/demo/test/temp/junit4-J2-20180314_043152_61113793989365072861320.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/demo/test/temp/junit4-J0-20180314_043152_6116782543157460172434.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 173 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/expressions/test/temp/junit4-J2-20180314_043155_4204588471008145469068.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/expressions/test/temp/junit4-J1-20180314_043155_4201637440362526152098.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/expressions/test/temp/junit4-J0-20180314_043155_42017122436832347059941.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 232 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/facet/test/temp/junit4-J1-20180314_043201_2238044201500008435134.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/facet/test/temp/junit4-J0-20180314_043201_2232231165136548879087.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/facet/test/temp/junit4-J2-20180314_043201_22313242559367585598449.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 182 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/grouping/test/temp/junit4-J2-20180314_043230_46414953572479841046067.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/grouping/test/temp/junit4-J0-20180314_043230_46416846616882420643762.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/grouping/test/temp/junit4-J1-20180314_043230_4643999276797497059595.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 255 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J2-20180314_043246_69214059769376299062654.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J1-20180314_043246_69214261999949032768646.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J0-20180314_043246_6922872326328279530730.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 163 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/join/test/temp/junit4-J1-20180314_043306_71650179815544618663.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/join/test/temp/junit4-J0-20180314_043306_7168449642199816169549.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/join/test/temp/junit4-J2-20180314_043306_71612509850100430818675.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 155 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/memory/test/temp/junit4-J0-20180314_043332_1845428921928224500207.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/memory/test/temp/junit4-J1-20180314_043332_1852108988743762008826.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 189 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/misc/test/temp/junit4-J1-20180314_043342_8849592383415035862875.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/misc/test/temp/junit4-J0-20180314_043342_8849429007894574496908.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/misc/test/temp/junit4-J2-20180314_043342_88412065932740031205647.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 344 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/queries/test/temp/junit4-J1-20180314_043357_63713317593169545962109.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/queries/test/temp/junit4-J2-20180314_043357_63717898249955591340555.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/queries/test/temp/junit4-J0-20180314_043357_6375490932979848707720.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 232 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J1-20180314_043405_1542787571501340504577.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J0-20180314_043405_1543279390320093512594.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J2-20180314_043405_1541923488619114350346.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 212 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/replicator/test/temp/junit4-J1-20180314_043411_9573053670411125977329.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/replicator/test/temp/junit4-J2-20180314_043411_9571109458168969762524.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/replicator/test/temp/junit4-J0-20180314_043411_9576211598328186947497.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 223 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J2-20180314_043422_6686629492556911184875.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J0-20180314_043422_6688996986284580173753.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J1-20180314_043422_66814764781708476245389.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 320 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20180314_043512_2743264768876120827776.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20180314_043512_2748830000501566134023.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20180314_043512_2741118589813578452043.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 153 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/spatial/test/temp/junit4-J0-20180314_043532_22610973464888863066618.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 181 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20180314_043534_2429140359783975832371.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20180314_043534_242267568094764587389.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 8 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20180314_043534_24217021559405211329245.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 260 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/suggest/test/temp/junit4-J2-20180314_043633_8243250543047036019416.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/suggest/test/temp/junit4-J0-20180314_043633_8244598145565798315828.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/suggest/test/temp/junit4-J1-20180314_043633_82413452165438730580188.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 2898 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
   [junit4]   2> 1347781 INFO  (SUITE-TestReplicationHandler-seed#[46C32BA68EC3222E]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_46C32BA68EC3222E-001/init-core-data-001
   [junit4]   2> 1347781 WARN  (SUITE-TestReplicationHandler-seed#[46C32BA68EC3222E]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 1347781 INFO  (SUITE-TestReplicationHandler-seed#[46C32BA68EC3222E]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1347781 INFO  (SUITE-TestReplicationHandler-seed#[46C32BA68EC3222E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="None")
   [junit4]   2> 1347782 INFO  (TEST-T

[...truncated too long message...]

State New IndexWriter is ready to be used.
   [junit4]   2> 120658 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@11cd3bf8[collection1] main]
   [junit4]   2> 120658 INFO  (searcherExecutor-1436-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@11cd3bf8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.4.0):c3) Uninverting(_1(7.4.0):c3)))}
   [junit4]   2> 120658 INFO  (qtp616662706-2503) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:32855/solr/collection1/replication&command=fetchindex} status=0 QTime=7
   [junit4]   2> 120659 INFO  (qtp616662706-2501) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=6 status=0 QTime=0
   [junit4]   2> 120660 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.h.TestReplicationHandler Waited for 0ms and found 6 docs
   [junit4]   2> 120660 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@695d44f7{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 120660 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=840258714
   [junit4]   2> 120660 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 120660 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 120661 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 120661 INFO  (coreCloseExecutor-1455-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@53ff59fc
   [junit4]   2> 120661 INFO  (coreCloseExecutor-1455-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1409243644
   [junit4]   2> 120662 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1f1efe6{/solr,null,UNAVAILABLE}
   [junit4]   2> 120662 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 120662 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending doTestRepeater
   [junit4]   2> 120662 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@7b91ebff{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 120662 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1632716146
   [junit4]   2> 120663 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 120663 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 120663 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 120663 INFO  (coreCloseExecutor-1457-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@15a7446b
   [junit4]   2> 120663 INFO  (coreCloseExecutor-1457-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=363283563
   [junit4]   2> 120664 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7b936e4e{/solr,null,UNAVAILABLE}
   [junit4]   2> 120664 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 120665 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@65df743e{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 120665 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=443159497
   [junit4]   2> 120665 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 120665 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 120665 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 120665 INFO  (coreCloseExecutor-1459-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3f3b026c
   [junit4]   2> 120665 INFO  (coreCloseExecutor-1459-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1060831852
   [junit4]   2> 120666 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@173a1e28{/solr,null,UNAVAILABLE}
   [junit4]   2> 120666 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[46C32BA68EC3222E]) [    ] o.e.j.s.session Stopped scavenging
   [junit4] OK      0.30s J2 | TestReplicationHandler.doTestRepeater
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_46C32BA68EC3222E-002
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {name=PostingsFormat(name=Asserting), id=PostingsFormat(name=Asserting), newname=PostingsFormat(name=Asserting)}, docValues:{}, maxPointsInLeafNode=1265, maxMBSortInHeap=7.1228026277932965, sim=RandomSimilarity(queryNorm=true): {}, locale=en-ZM, timezone=Africa/Maputo
   [junit4]   2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=232161304,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestReplicationHandler, TestReplicationHandler]
   [junit4] Completed [5/5 (5!)] on J2 in 58.56s, 16 tests, 1 error <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 46C32BA68EC3222E]:
   [junit4]   - org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart
   [junit4]   - org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart
   [junit4]   - org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart
   [junit4]   - org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart
   [junit4]   - org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.76 ..    72.37 =    71.61s
   [junit4] JVM J1:     0.76 ..   114.43 =   113.67s
   [junit4] JVM J2:     0.76 ..   123.64 =   122.89s
   [junit4] Execution time total: 2 minutes 3 seconds
   [junit4] Tests summary: 5 suites, 80 tests, 5 errors

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 80 tests, 5 errors [seed: 46C32BA68EC3222E]

Total time: 2 minutes 5 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.handler.TestReplicationHandler
[repro]   5/5 failed: org.apache.solr.ltr.TestLTRReRankingPipeline
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=e7dd3fc26c4e4dac17f18ae0e81bfc1356fb7df4, workspace=/var/lib/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #7
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-BadApples-7.x-Linux (64bit/jdk-9.0.4) - Build # 15 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/15/
Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.SSLMigrationTest.test

Error Message:
Replica didn't have the proper urlScheme in the ClusterState

Stack Trace:
java.lang.AssertionError: Replica didn't have the proper urlScheme in the ClusterState
	at __randomizedtesting.SeedInfo.seed([CE21ADAD0E49BB44:46759277A0B5D6BC]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.SSLMigrationTest.assertReplicaInformation(SSLMigrationTest.java:104)
	at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:97)
	at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1793 lines...]
   [junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/core/test/temp/junit4-J0-20180328_060711_86318398767856363922667.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] codec: CheapBastard, pf: LuceneVarGapDocFreqInterval, dvf: Asserting
   [junit4] <<< JVM J0: EOF ----

[...truncated 10503 lines...]
   [junit4] Suite: org.apache.solr.cloud.SSLMigrationTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/init-core-data-001
   [junit4]   2> 128008 WARN  (SUITE-SSLMigrationTest-seed#[CE21ADAD0E49BB44]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 128008 INFO  (SUITE-SSLMigrationTest-seed#[CE21ADAD0E49BB44]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 128008 INFO  (SUITE-SSLMigrationTest-seed#[CE21ADAD0E49BB44]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="None")
   [junit4]   2> 128008 INFO  (SUITE-SSLMigrationTest-seed#[CE21ADAD0E49BB44]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 128009 INFO  (SUITE-SSLMigrationTest-seed#[CE21ADAD0E49BB44]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_tbp/nu
   [junit4]   2> 128011 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 128011 INFO  (Thread-134) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 128011 INFO  (Thread-134) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 128012 ERROR (Thread-134) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 128111 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.ZkTestServer start zk server on port:45769
   [junit4]   2> 128114 INFO  (zkConnectionManagerCallback-162-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 128121 INFO  (zkConnectionManagerCallback-164-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 128124 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 128125 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 128126 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 128127 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 128127 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 128128 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 128129 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 128129 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 128130 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 128131 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 128131 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 128132 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 128251 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 128263 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 128263 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 128263 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 128268 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6e818867{/_tbp/nu,null,AVAILABLE}
   [junit4]   2> 128269 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7d791b4c{HTTP/1.1,[http/1.1]}{127.0.0.1:37893}
   [junit4]   2> 128269 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.Server Started @128310ms
   [junit4]   2> 128269 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_tbp/nu, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/tempDir-001/control/data, hostPort=37893, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/control-001/cores}
   [junit4]   2> 128270 ERROR (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 128270 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 128270 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.4.0
   [junit4]   2> 128270 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 128270 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 128270 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-28T06:31:57.852581Z
   [junit4]   2> 128284 INFO  (zkConnectionManagerCallback-166-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 128285 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 128285 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/control-001/solr.xml
   [junit4]   2> 128287 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 128288 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 128288 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 128300 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45769/solr
   [junit4]   2> 128305 INFO  (zkConnectionManagerCallback-170-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 128311 INFO  (zkConnectionManagerCallback-172-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 128356 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 128357 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37893__tbp%2Fnu
   [junit4]   2> 128357 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.c.Overseer Overseer (id=72212018132680708-127.0.0.1:37893__tbp%2Fnu-n_0000000000) starting
   [junit4]   2> 128371 INFO  (zkConnectionManagerCallback-177-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 128373 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45769/solr ready
   [junit4]   2> 128387 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37893__tbp%2Fnu
   [junit4]   2> 128408 INFO  (zkCallback-176-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 128412 INFO  (zkCallback-171-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 128555 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 128565 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 128565 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 128566 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/control-001/cores
   [junit4]   2> 128590 INFO  (zkConnectionManagerCallback-181-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 128592 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 128593 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45769/solr ready
   [junit4]   2> 128598 INFO  (qtp1650841556-620) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37893__tbp%252Fnu&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 128605 INFO  (OverseerThreadFactory-305-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 128729 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 128729 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 128844 INFO  (zkCallback-171-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 129784 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 129797 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 129873 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 129897 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 129897 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 129898 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 129898 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 129901 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=48.4462890625, floorSegmentMB=0.5146484375, forceMergeDeletesPctAllowed=5.015790233005486, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1374881041189572
   [junit4]   2> 129909 WARN  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 129942 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 129942 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 129943 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 129943 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 129943 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=512997658, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 129944 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@624e7801[control_collection_shard1_replica_n1] main]
   [junit4]   2> 129944 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 129945 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 129945 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 129946 INFO  (searcherExecutor-308-thread-1-processing-n:127.0.0.1:37893__tbp%2Fnu x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@624e7801[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 129946 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596162016047792128
   [junit4]   2> 129949 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 129951 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 129951 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 129951 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37893/_tbp/nu/control_collection_shard1_replica_n1/
   [junit4]   2> 129951 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 129951 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:37893/_tbp/nu/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 129951 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 129952 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37893/_tbp/nu/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 130053 INFO  (zkCallback-171-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 130103 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 130104 INFO  (qtp1650841556-662) [n:127.0.0.1:37893__tbp%2Fnu c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1375
   [junit4]   2> 130107 INFO  (qtp1650841556-620) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 130206 INFO  (zkCallback-171-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 130607 INFO  (OverseerCollectionConfigSetProcessor-72212018132680708-127.0.0.1:37893__tbp%2Fnu-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 131107 INFO  (qtp1650841556-620) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37893__tbp%252Fnu&wt=javabin&version=2} status=0 QTime=2509
   [junit4]   2> 131127 INFO  (zkConnectionManagerCallback-185-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 131128 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 131129 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45769/solr ready
   [junit4]   2> 131131 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 131133 INFO  (qtp1650841556-661) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 131135 INFO  (OverseerThreadFactory-305-thread-2) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 131136 WARN  (OverseerThreadFactory-305-thread-2) [    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 131340 INFO  (qtp1650841556-661) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 131340 INFO  (qtp1650841556-661) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=206
   [junit4]   2> 131435 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-1-001 of type NRT
   [junit4]   2> 131436 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 131437 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 131437 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 131437 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 131437 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@558ede7d{/_tbp/nu,null,AVAILABLE}
   [junit4]   2> 131437 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@358e0e92{HTTP/1.1,[http/1.1]}{127.0.0.1:39391}
   [junit4]   2> 131437 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.Server Started @131478ms
   [junit4]   2> 131438 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_tbp/nu, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/tempDir-001/jetty1, hostPort=39391, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-1-001/cores, replicaType=NRT}
   [junit4]   2> 131438 ERROR (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 131438 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 131438 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.4.0
   [junit4]   2> 131438 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 131438 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 131438 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-28T06:32:01.020548Z
   [junit4]   2> 131439 INFO  (zkConnectionManagerCallback-187-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 131440 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 131441 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-1-001/solr.xml
   [junit4]   2> 131442 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 131442 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 131443 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 131445 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45769/solr
   [junit4]   2> 131446 INFO  (zkConnectionManagerCallback-191-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 131448 INFO  (zkConnectionManagerCallback-193-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 131452 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 131453 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 131454 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 131454 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39391__tbp%2Fnu
   [junit4]   2> 131455 INFO  (zkCallback-176-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 131455 INFO  (zkCallback-171-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 131455 INFO  (zkCallback-184-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 131456 INFO  (zkCallback-192-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 131585 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 131591 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 131592 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 131593 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-1-001/cores
   [junit4]   2> 131596 INFO  (zkConnectionManagerCallback-198-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 131596 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 131611 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45769/solr ready
   [junit4]   2> 131637 INFO  (qtp1650841556-625) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:39391__tbp%252Fnu&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 131639 INFO  (OverseerCollectionConfigSetProcessor-72212018132680708-127.0.0.1:37893__tbp%2Fnu-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 131641 INFO  (OverseerThreadFactory-305-thread-3) [    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:39391__tbp%2Fnu for creating new replica
   [junit4]   2> 131645 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 132685 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 132692 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
   [junit4]   2> 132761 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 132772 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
   [junit4]   2> 132772 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 132772 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 132772 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
   [junit4]   2> 132774 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=48.4462890625, floorSegmentMB=0.5146484375, forceMergeDeletesPctAllowed=5.015790233005486, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1374881041189572
   [junit4]   2> 132777 WARN  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 132813 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 132813 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 132814 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 132814 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 132815 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=512997658, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 132815 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@9e0b7d8[collection1_shard2_replica_n41] main]
   [junit4]   2> 132816 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 132816 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 132817 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 132817 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596162019058253824
   [junit4]   2> 132817 INFO  (searcherExecutor-319-thread-1-processing-n:127.0.0.1:39391__tbp%2Fnu x:collection1_shard2_replica_n41 c:collection1 s:shard2) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@9e0b7d8[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 132820 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node42=0}, version=0}
   [junit4]   2> 132821 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 132821 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 132821 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:39391/_tbp/nu/collection1_shard2_replica_n41/
   [junit4]   2> 132821 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 132821 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:39391/_tbp/nu/collection1_shard2_replica_n41/ has no replicas
   [junit4]   2> 132821 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 132822 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:39391/_tbp/nu/collection1_shard2_replica_n41/ shard2
   [junit4]   2> 132973 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 132975 INFO  (qtp667912509-677) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1329
   [junit4]   2> 132977 INFO  (qtp1650841556-625) [n:127.0.0.1:37893__tbp%2Fnu    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:39391__tbp%252Fnu&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1340
   [junit4]   2> 133069 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-2-001 of type NRT
   [junit4]   2> 133070 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 133071 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 133071 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 133071 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 133071 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9b5f893{/_tbp/nu,null,AVAILABLE}
   [junit4]   2> 133072 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1111b75c{HTTP/1.1,[http/1.1]}{127.0.0.1:35727}
   [junit4]   2> 133072 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.Server Started @133112ms
   [junit4]   2> 133072 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_tbp/nu, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/tempDir-001/jetty2, hostPort=35727, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-2-001/cores, replicaType=NRT}
   [junit4]   2> 133072 ERROR (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 133072 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 133072 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.4.0
   [junit4]   2> 133072 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 133073 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 133073 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-28T06:32:02.655043Z
   [junit4]   2> 133074 INFO  (zkConnectionManagerCallback-200-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 133075 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 133075 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-2-001/solr.xml
   [junit4]   2> 133077 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 133077 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 133077 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 133080 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45769/solr
   [junit4]   2> 133081 INFO  (zkConnectionManagerCallback-204-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 133083 INFO  (zkConnectionManagerCallback-206-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 133086 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 133087 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 133088 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 133088 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35727__tbp%2Fnu
   [junit4]   2> 133089 INFO  (zkCallback-176-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 133089 INFO  (zkCallback-192-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 133089 INFO  (zkCallback-171-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 133089 INFO  (zkCallback-197-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 133089 INFO  (zkCallback-205-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 133089 INFO  (zkCallback-184-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 133182 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 133188 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 133188 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 133189 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-2-001/cores
   [junit4]   2> 133192 INFO  (zkConnectionManagerCallback-211-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 133193 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 133194 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45769/solr ready
   [junit4]   2> 133217 INFO  (qtp367649489-712) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35727__tbp%252Fnu&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 133219 INFO  (OverseerCollectionConfigSetProcessor-72212018132680708-127.0.0.1:37893__tbp%2Fnu-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 133220 INFO  (OverseerThreadFactory-305-thread-4) [    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:35727__tbp%2Fnu for creating new replica
   [junit4]   2> 133223 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 134237 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 134260 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
   [junit4]   2> 134342 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 134352 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
   [junit4]   2> 134352 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 134352 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 134352 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
   [junit4]   2> 134355 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=48.4462890625, floorSegmentMB=0.5146484375, forceMergeDeletesPctAllowed=5.015790233005486, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1374881041189572
   [junit4]   2> 134357 WARN  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 134409 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 134409 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 134410 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 134410 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 134410 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=512997658, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 134411 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@50935823[collection1_shard1_replica_n43] main]
   [junit4]   2> 134411 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 134412 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 134412 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 134412 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596162020730732544
   [junit4]   2> 134413 INFO  (searcherExecutor-330-thread-1-processing-n:127.0.0.1:35727__tbp%2Fnu x:collection1_shard1_replica_n43 c:collection1 s:shard1) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@50935823[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 134415 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node44=0}, version=0}
   [junit4]   2> 134416 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 134416 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 134416 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35727/_tbp/nu/collection1_shard1_replica_n43/
   [junit4]   2> 134416 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 134416 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:35727/_tbp/nu/collection1_shard1_replica_n43/ has no replicas
   [junit4]   2> 134416 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 134418 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35727/_tbp/nu/collection1_shard1_replica_n43/ shard1
   [junit4]   2> 134568 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 134570 INFO  (qtp367649489-718) [n:127.0.0.1:35727__tbp%2Fnu c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1347
   [junit4]   2> 134573 INFO  (qtp367649489-712) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:35727__tbp%252Fnu&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1355
   [junit4]   2> 134646 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-3-001 of type NRT
   [junit4]   2> 134647 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 134648 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 134648 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 134648 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 134648 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a67583d{/_tbp/nu,null,AVAILABLE}
   [junit4]   2> 134649 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4e125e8c{HTTP/1.1,[http/1.1]}{127.0.0.1:39843}
   [junit4]   2> 134649 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.Server Started @134689ms
   [junit4]   2> 134649 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_tbp/nu, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/tempDir-001/jetty3, hostPort=39843, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-3-001/cores, replicaType=NRT}
   [junit4]   2> 134649 ERROR (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 134649 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 134649 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.4.0
   [junit4]   2> 134649 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 134649 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 134650 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-28T06:32:04.231970Z
   [junit4]   2> 134651 INFO  (zkConnectionManagerCallback-213-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 134651 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 134651 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-3-001/solr.xml
   [junit4]   2> 134653 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 134653 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 134664 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 134666 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45769/solr
   [junit4]   2> 134667 INFO  (zkConnectionManagerCallback-217-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 134669 INFO  (zkConnectionManagerCallback-219-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 134672 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39843__tbp%2Fnu    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 134673 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39843__tbp%2Fnu    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 134674 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39843__tbp%2Fnu    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 134675 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39843__tbp%2Fnu    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39843__tbp%2Fnu
   [junit4]   2> 134675 INFO  (zkCallback-210-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 134675 INFO  (zkCallback-176-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 134675 INFO  (zkCallback-205-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 134675 INFO  (zkCallback-197-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 134675 INFO  (zkCallback-192-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 134675 INFO  (zkCallback-184-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 134675 INFO  (zkCallback-171-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 134685 INFO  (zkCallback-218-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 134841 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39843__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 134850 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39843__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 134851 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39843__tbp%2Fnu    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 134852 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39843__tbp%2Fnu    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-3-001/cores
   [junit4]   2> 134872 INFO  (zkConnectionManagerCallback-224-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 134872 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39843__tbp%2Fnu    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 134873 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [n:127.0.0.1:39843__tbp%2Fnu    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45769/solr ready
   [junit4]   2> 134898 INFO  (qtp367649489-716) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:39843__tbp%252Fnu&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 134899 INFO  (OverseerCollectionConfigSetProcessor-72212018132680708-127.0.0.1:37893__tbp%2Fnu-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 134900 INFO  (OverseerThreadFactory-305-thread-5) [    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:39843__tbp%2Fnu for creating new replica
   [junit4]   2> 134903 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 135914 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 135921 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema [collection1_shard2_replica_n45] Schema name=test
   [junit4]   2> 136004 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 136016 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n45' using configuration from collection collection1, trusted=true
   [junit4]   2> 136016 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n45' (registry 'solr.core.collection1.shard2.replica_n45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d006d9
   [junit4]   2> 136016 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 136016 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [[collection1_shard2_replica_n45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-3-001/cores/collection1_shard2_replica_n45], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-3-001/cores/collection1_shard2_replica_n45/data/]
   [junit4]   2> 136019 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=48.4462890625, floorSegmentMB=0.5146484375, forceMergeDeletesPctAllowed=5.015790233005486, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1374881041189572
   [junit4]   2> 136021 WARN  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 136059 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 136059 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 136060 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 136060 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 136060 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=512997658, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 136061 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.s.SolrIndexSearcher Opening [Searcher@5c6ec4a6[collection1_shard2_replica_n45] main]
   [junit4]   2> 136062 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 136062 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 136062 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 136062 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596162022460882944
   [junit4]   2> 136063 INFO  (searcherExecutor-341-thread-1-processing-n:127.0.0.1:39843__tbp%2Fnu x:collection1_shard2_replica_n45 c:collection1 s:shard2) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [collection1_shard2_replica_n45] Registered new searcher Searcher@5c6ec4a6[collection1_shard2_replica_n45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 136065 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node42=0, core_node46=0}, version=1}
   [junit4]   2> 136065 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_n45
   [junit4]   2> 136066 INFO  (updateExecutor-214-thread-1-processing-n:127.0.0.1:39843__tbp%2Fnu x:collection1_shard2_replica_n45 c:collection1 s:shard2) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 136067 INFO  (qtp2018517424-749) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1164
   [junit4]   2> 136069 INFO  (qtp367649489-716) [n:127.0.0.1:35727__tbp%2Fnu    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:39843__tbp%252Fnu&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1171
   [junit4]   2> 136076 INFO  (recoveryExecutor-215-thread-1-processing-n:127.0.0.1:39843__tbp%2Fnu x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 136076 INFO  (recoveryExecutor-215-thread-1-processing-n:127.0.0.1:39843__tbp%2Fnu x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 136086 INFO  (qtp667912509-683) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41]  webapp=/_tbp/nu path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=1
   [junit4]   2> 136086 INFO  (qtp667912509-683) [n:127.0.0.1:39391__tbp%2Fnu c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41]  webapp=/_tbp/nu path=/admin/ping params={wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 136086 INFO  (recoveryExecutor-215-thread-1-processing-n:127.0.0.1:39843__tbp%2Fnu x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_n45]
   [junit4]   2> 136086 INFO  (recoveryExecutor-215-thread-1-processing-n:127.0.0.1:39843__tbp%2Fnu x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 136086 INFO  (recoveryExecutor-215-thread-1-processing-n:127.0.0.1:39843__tbp%2Fnu x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_n45] as recovering, leader is [http://127.0.0.1:39391/_tbp/nu/collection1_shard2_replica_n41/] and I am [http://127.0.0.1:39843/_tbp/nu/collection1_shard2_replica_n45/]
   [junit4]   2> 136099 INFO  (recoveryExecutor-215-thread-1-processing-n:127.0.0.1:39843__tbp%2Fnu x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node42=0, core_node46=0, core_node46_recovering=0}, version=2}
   [junit4]   2> 136102 INFO  (recoveryExecutor-215-thread-1-processing-n:127.0.0.1:39843__tbp%2Fnu x:collection1_shard2_replica_n45 c:collection1 s:shard2 r:core_node46) [n:127.0.0.1:39843__tbp%2Fnu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:39391/_tbp/nu]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_n41&nodeName=127.0.0.1:39843__tbp%252Fnu&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 136104 INFO  (qtp667912509-683) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 136105 INFO  (qtp667912509-683) [n:127.0.0.1:39391__tbp%2Fnu    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_n41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:39843__tbp%2Fnu, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_n45","base_url":"http://127.0.0.1:39843/_tbp/nu","node_name":"127.0.0.1:39843__tbp%2Fnu","state":"down","type":"NRT"}
   [junit4]   2> 136169 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-4-001 of type NRT
   [junit4]   2> 136170 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 136170 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 136170 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 136170 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 136171 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3b51a45e{/_tbp/nu,null,AVAILABLE}
   [junit4]   2> 136171 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@64b780a{HTTP/1.1,[http/1.1]}{127.0.0.1:40259}
   [junit4]   2> 136172 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.Server Started @136212ms
   [junit4]   2> 136172 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_tbp/nu, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/tempDir-001/jetty4, hostPort=40259, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001/shard-4-001/cores}
   [junit4]   2> 136172 ERROR (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 136172 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.s.SolrDispatchFilter Using logger f

[...truncated too long message...]

	at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1268) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1235) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1191) [java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1091) [java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1019) [java/:?]
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:187) [java/:?]
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) [java/:?]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167) [?:?]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) [?:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:844) [?:?]
   [junit4]   2> 152472 ERROR (coreZkRegister-398-thread-1-processing-n:127.0.0.1:40259__tbp%2Fnu x:collection1_shard1_replica_n47 c:collection1 s:shard1 r:core_node48) [n:127.0.0.1:40259__tbp%2Fnu c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_n47] o.a.s.c.ZkContainer :org.apache.solr.common.SolrException: Error while saving shard term for collection: collection1
   [junit4]   2> 	at org.apache.solr.cloud.ZkShardTerms.saveTerms(ZkShardTerms.java:307)
   [junit4]   2> 	at org.apache.solr.cloud.ZkShardTerms.removeTerm(ZkShardTerms.java:182)
   [junit4]   2> 	at org.apache.solr.cloud.ZkShardTerms.removeTerm(ZkShardTerms.java:173)
   [junit4]   2> 	at org.apache.solr.cloud.ZkCollectionTerms.remove(ZkCollectionTerms.java:52)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1506)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1151)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:1019)
   [junit4]   2> 	at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:187)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/terms/shard1
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1330)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:352)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:352)
   [junit4]   2> 	at org.apache.solr.cloud.ZkShardTerms.saveTerms(ZkShardTerms.java:297)
   [junit4]   2> 	... 11 more
   [junit4]   2> 
   [junit4]   2> 152473 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@398b70bb{SSL,[ssl, http/1.1]}{127.0.0.1:40259}
   [junit4]   2> 152473 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6f860b60{/_tbp/nu,null,UNAVAILABLE}
   [junit4]   2> 152473 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 152473 ERROR (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 152483 INFO  (TEST-SSLMigrationTest.test-seed#[CE21ADAD0E49BB44]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45769 45769
   [junit4]   2> 152907 INFO  (Thread-134) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45769 45769
   [junit4]   2> 152908 WARN  (Thread-134) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	20	/solr/aliases.json
   [junit4]   2> 	9	/solr/security.json
   [junit4]   2> 	9	/solr/configs/conf1
   [junit4]   2> 	9	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	9	/solr/collections/collection1/terms/shard2
   [junit4]   2> 	8	/solr/collections/collection1/state.json
   [junit4]   2> 	2	/solr/collections/control_collection/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	20	/solr/clusterprops.json
   [junit4]   2> 	20	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/overseer_elect/election/72212018132680708-127.0.0.1:37893__tbp%2Fnu-n_0000000000
   [junit4]   2> 	5	/solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	20	/solr/live_nodes
   [junit4]   2> 	20	/solr/collections
   [junit4]   2> 	5	/solr/overseer/queue
   [junit4]   2> 	5	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	5	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	5	/solr/overseer/collection-queue-work
   [junit4]   2> 	5	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SSLMigrationTest -Dtests.method=test -Dtests.seed=CE21ADAD0E49BB44 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=fr-TD -Dtests.timezone=Asia/Novokuznetsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 24.9s J0 | SSLMigrationTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Replica didn't have the proper urlScheme in the ClusterState
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CE21ADAD0E49BB44:46759277A0B5D6BC]:0)
   [junit4]    > 	at org.apache.solr.cloud.SSLMigrationTest.assertReplicaInformation(SSLMigrationTest.java:104)
   [junit4]    > 	at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:97)
   [junit4]    > 	at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SSLMigrationTest_CE21ADAD0E49BB44-001
   [junit4]   2> Mar 28, 2018 6:32:22 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1951, maxMBSortInHeap=5.704288344234641, sim=RandomSimilarity(queryNorm=true): {}, locale=fr-TD, timezone=Asia/Novokuznetsk
   [junit4]   2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=234477016,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrCloudWithSecureImpersonation, PreAnalyzedUpdateProcessorTest, TestAddFieldRealTimeGet, TestIntervalFaceting, DateRangeFieldTest, BinaryUpdateRequestHandlerTest, TestPushWriter, TestFieldCacheSortRandom, TestRemoteStreaming, TestComponentsName, BadIndexSchemaTest, TestSolr4Spatial2, TestLegacyFieldCache, SolrIndexSplitterTest, DeleteNodeTest, DocExpirationUpdateProcessorFactoryTest, TestSchemaResource, TestDocSet, SpellingQueryConverterTest, CoreAdminOperationTest, TestSimpleTextCodec, SSLMigrationTest]
   [junit4] Completed [44/785 (1!)] on J0 in 25.42s, 1 test, 1 failure <<< FAILURES!

[...truncated 45177 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/15/consoleText

[repro] Revision: 8b8187d1ee81e04d6bf7f7484e95224fe36683f4

[repro] Repro line:  ant test  -Dtestcase=SSLMigrationTest -Dtests.method=test -Dtests.seed=CE21ADAD0E49BB44 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=fr-TD -Dtests.timezone=Asia/Novokuznetsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       SSLMigrationTest
[repro] ant compile-test

[...truncated 3319 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.SSLMigrationTest" -Dtests.showOutput=onerror  -Dtests.seed=CE21ADAD0E49BB44 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=fr-TD -Dtests.timezone=Asia/Novokuznetsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 76 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.SSLMigrationTest
[repro] Exiting with code 0

[...truncated 40 lines...]

[JENKINS] Lucene-Solr-BadApples-7.x-Linux (32bit/jdk1.8.0_162) - Build # 14 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/14/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([6CC5D2B5633C4CE:2AFE2AA6DAF7B24A]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:914)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:264)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=int_i:14&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:907)
	... 40 more




Build Log:
[...truncated 1788 lines...]
   [junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/core/test/temp/junit4-J0-20180326_033745_2654261846417776136996.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] codec: DummyCompressingStoredFields, pf: FST50, dvf: Memory
   [junit4] <<< JVM J0: EOF ----

[...truncated 12924 lines...]
   [junit4] Suite: org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_6CC5D2B5633C4CE-001/init-core-data-001
   [junit4]   2> 2719472 WARN  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=17 numCloses=17
   [junit4]   2> 2719472 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2719474 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2719474 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2719474 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 2719474 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2719500 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 2719516 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 2719612 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2719652 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14cbe0f
   [junit4]   2> 2719663 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14cbe0f
   [junit4]   2> 2719663 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14cbe0f
   [junit4]   2> 2719669 INFO  (coreLoadExecutor-10925-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2719669 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2719695 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 2719727 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 2719832 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2719839 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 2719840 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14cbe0f
   [junit4]   2> 2719840 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2719840 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_6CC5D2B5633C4CE-001/init-core-data-001/]
   [junit4]   2> 2719842 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=89.935546875, floorSegmentMB=0.8740234375, forceMergeDeletesPctAllowed=27.708475038112777, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 2719881 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2719881 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2719882 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2719882 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2719883 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=89.029296875, floorSegmentMB=0.7275390625, forceMergeDeletesPctAllowed=11.523874980716375, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2719883 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d60b72[collection1] main]
   [junit4]   2> 2719884 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 2719905 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 2719992 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2719992 INFO  (searcherExecutor-10926-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 2719992 INFO  (coreLoadExecutor-10925-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1595974312068644864
   [junit4]   2> 2719992 INFO  (searcherExecutor-10926-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 2719992 INFO  (searcherExecutor-10926-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 2719992 INFO  (searcherExecutor-10926-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 2719992 INFO  (searcherExecutor-10926-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 2719992 INFO  (searcherExecutor-10926-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 2719992 INFO  (searcherExecutor-10926-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 2719992 INFO  (searcherExecutor-10926-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 2719992 INFO  (searcherExecutor-10926-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 2719993 INFO  (searcherExecutor-10926-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1d60b72[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2719995 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 2719998 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoUniqueIdPassed
   [junit4]   2> 2720001 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoUniqueIdPassed
   [junit4]   2> 2720005 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBasics
   [junit4]   2> 2720006 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595974312083324928,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2720006 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1804636 commitCommandVersion:1595974312083324928
   [junit4]   2> 2720008 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@33d394[collection1] main]
   [junit4]   2> 2720009 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2720010 INFO  (searcherExecutor-10926-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@33d394[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.4.0):C1)))}
   [junit4]   2> 2720010 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2720012 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720013 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:human&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720013 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Mr&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720013 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:20&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720013 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name_s:Virat&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720013 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=multiDefault:Delhi&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720015 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595974312092762112,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2720015 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1804636 commitCommandVersion:1595974312092762112
   [junit4]   2> 2720016 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@86c553[collection1] main]
   [junit4]   2> 2720017 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2720019 INFO  (searcherExecutor-10926-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@86c553[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(7.4.0):C1)))}
   [junit4]   2> 2720019 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 2720019 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720019 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:human&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720020 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:animal&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720020 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&indent=true&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720020 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Mr&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2720020 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Dr&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720020 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:20&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2720021 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:40&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720021 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name_s:Virat&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2720021 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=multiDefault:Delhi&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2720022 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBasics
   [junit4]   2> 2720025 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMultipleThreads
   [junit4]   2> 2720025 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2720025 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@884a06[collection1] realtime]
   [junit4]   2> 2720026 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
   [junit4]   2> 2720030 WARN  (Thread-7282) [    ] o.a.s.u.p.AtomicUpdateProcessorFactory Atomic update failed due to version conflict for 10 expected=1595974312105345024 actual=1595974312107442179Retrying with new version .... (1)
   [junit4]   2> 2720030 WARN  (Thread-7283) [    ] o.a.s.u.p.AtomicUpdateProcessorFactory Atomic update failed due to version conflict for 10 expected=1595974312105345024 actual=1595974312107442179Retrying with new version .... (1)
   [junit4]   2> 2720030 WARN  (Thread-7284) [    ] o.a.s.u.p.AtomicUpdateProcessorFactory Atomic update failed due to version conflict for 10 expected=1595974312105345024 actual=1595974312107442179Retrying with new version .... (1)
   [junit4]   2> 2720030 WARN  (Thread-7283) [    ] o.a.s.u.p.AtomicUpdateProcessorFactory Atomic update failed due to version conflict for 10 expected=1595974312107442179 actual=1595974312108490752Retrying with new version .... (2)
   [junit4]   2> 2720030 WARN  (Thread-7284) [    ] o.a.s.u.p.AtomicUpdateProcessorFactory Atomic update failed due to version conflict for 10 expected=1595974312107442179 actual=1595974312108490752Retrying with new version .... (2)
   [junit4]   2> 2720030 WARN  (Thread-7284) [    ] o.a.s.u.p.AtomicUpdateProcessorFactory Atomic update failed due to version conflict for 10 expected=1595974312108490752 actual=1595974312108490753Retrying with new version .... (3)
   [junit4]   2> 2720030 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595974312108490755,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2720030 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1804636 commitCommandVersion:1595974312108490755
   [junit4]   2> 2720032 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5bec06[collection1] main]
   [junit4]   2> 2720032 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2720034 INFO  (searcherExecutor-10926-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5bec06[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(7.4.0):C10/9:delGen=1)))}
   [junit4]   2> 2720034 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2720034 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:10&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720035 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:w92hfesj8fhunlf2cda1+oq959w4uglyx1qi29v9n+n4qzv6j0u3qmkx5mdct3+smmygyqwf7y2mf6ryv29+egv7emzl2qxc6o39xlma&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2720035 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=int_i:14&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2720035 ERROR (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=int_i:14&wt=xml
   [junit4]   2> 2720036 ERROR (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=int_i:14&wt=xml:java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=int_i:14&wt=xml
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:907)
   [junit4]   2> 	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:264)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 2720037 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMultipleThreads
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=AtomicUpdateProcessorFactoryTest -Dtests.method=testMultipleThreads -Dtests.seed=6CC5D2B5633C4CE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr-ME -Dtests.timezone=America/Argentina/Jujuy -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.02s J0 | AtomicUpdateProcessorFactoryTest.testMultipleThreads <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([6CC5D2B5633C4CE:2AFE2AA6DAF7B24A]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:914)
   [junit4]    > 	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:264)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]    > </response>
   [junit4]    > 	request was:q=int_i:14&wt=xml
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:907)
   [junit4]    > 	... 40 more
   [junit4]   2> 2720042 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testWrongAtomicOpPassed
   [junit4]   2> 2720042 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[6CC5D2B5633C4CE]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testWrongAtomicOpPassed
   [junit4]   2> 2720043 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 2720043 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=3636340
   [junit4]   2> 2720043 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2720043 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1718670: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@15fd374
   [junit4]   2> 2720046 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2720046 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@117c359: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@ead145
   [junit4]   2> 2720049 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2720049 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[6CC5D2B5633C4CE]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@b3e7b1: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@dba119
   [junit4]   2> 2720049 INFO  (coreCloseExecutor-10931-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@a103c4
   [junit4]   2> 2720049 INFO  (coreCloseExecutor-10931-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=10552260
   [junit4]   2> 2720049 INFO  (coreCloseExecutor-10931-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@727aa2: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@1927ee5
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_6CC5D2B5633C4CE-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=sr-ME, timezone=America/Argentina/Jujuy
   [junit4]   2> NOTE: Linux 4.13.0-36-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=168553784,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [DeleteStatusTest, TestOverriddenPrefixQueryForCustomFieldType, ScheduledMaintenanceTriggerTest, UpdateLogTest, TestFilteredDocIdSet, CleanupOldIndexTest, TestDistribDocBasedVersion, TestSimpleTextCodec, AliasIntegrationTest, TestJsonFacetRefinement, CurrencyRangeFacetCloudTest, BlockJoinFacetSimpleTest, RAMDirectoryFactoryTest, CdcrReplicationHandlerTest, SolrPluginUtilsTest, TestSolrCloudWithSecureImpersonation, BlobRepositoryCloudTest, LeaderElectionContextKeyTest, SolrRequestParserTest, V2StandaloneTest, DistribJoinFromCollectionTest, BadIndexSchemaTest, TestBackupRepositoryFactory, ExitableDirectoryReaderTest, OverseerModifyCollectionTest, SynonymTokenizerTest, PluginInfoTest, TestSimDistributedQueue, TestSegmentSorting, CoreAdminOperationTest, HdfsSyncSliceTest, TestTolerantUpdateProcessorRandomCloud, TestLegacyFieldCache, TestSchemalessBufferedUpdates, SolrIndexMetricsTest, MBeansHandlerTest, DeleteNodeTest, TestGeoJSONResponseWriter, TestDocumentBuilder, ClassificationUpdateProcessorIntegrationTest, TestSolrDeletionPolicy1, TestWriterPerf, TestGroupingSearch, SuggesterWFSTTest, TestHighlightDedupGrouping, TestBulkSchemaAPI, TestSolrCLIRunExample, UUIDUpdateProcessorFallbackTest, StatsComponentTest, TestStressLiveNodes, TestDocSet, BitVectorTest, ExternalFileFieldSortTest, RemoteQueryErrorTest, MetricTriggerTest, TestReplicaProperties, DocValuesNotIndexedTest, TestSort, TestAddFieldRealTimeGet, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestCollationField, ZkCLITest, TestDistributedSearch, DirectUpdateHandlerTest, TestBinaryField, DistributedTermsComponentTest, TestEmbeddedSolrServerConstructors, SuggestComponentContextFilterQueryTest, DistributedQueryElevationComponentTest, TestRandomFaceting, TestRuleBasedAuthorizationPlugin, TestConfigSetsAPIZkFailure, HDFSCollectionsAPITest, TestLuceneMatchVersion, ConcurrentDeleteAndCreateCollectionTest, TestSerializedLuceneMatchVersion, TestIntervalFaceting, TestUseDocValuesAsStored2, TestReRankQParserPlugin, HdfsDirectoryTest, TestMinMaxOnMultiValuedField, TestFieldCacheSortRandom, BlockCacheTest, SolrIndexSplitterTest, MergeStrategyTest, TestXmlQParser, TestSQLHandler, ConfigSetsAPITest, TestComplexPhraseQParserPlugin, TestCollectionsAPIViaSolrCloudCluster, TestQueryWrapperFilter, RequestHandlersTest, SolrCoreCheckLockOnStartupTest, SpellingQueryConverterTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestExtendedDismaxParser, TestAuthenticationFramework, TestExclusionRuleCollectionAccess, ConfigureRecoveryStrategyTest, TestRebalanceLeaders, TestCSVLoader, ShardRoutingTest, HttpPartitionTest, TestCSVResponseWriter, SecurityConfHandlerTest, TestCustomStream, TestRemoteStreaming, ZkShardTermsTest, TestFastOutputStream, TestMacros, TriLevelCompositeIdRoutingTest, SimpleFacetsTest, TestUninvertingReader, BasicDistributedZkTest, TestSkipOverseerOperations, TestHashPartitioner, ShardSplitTest, TestConfigReload, TestClassicSimilarityFactory, TestLMDirichletSimilarityFactory, CreateRoutedAliasTest, TestCloudInspectUtil, TestFieldTypeCollectionResource, TestExpandComponent, TestRetrieveFieldsOptimizer, DocExpirationUpdateProcessorFactoryTest, DistributedFacetPivotLongTailTest, TestOnReconnectListenerSupport, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, ZkSolrClientTest, TestRandomDVFaceting, TestRealTimeGet, TestJoin, TestBadConfig, TestIndexSearcher, TestCoreDiscovery, SuggesterFSTTest, CoreAdminHandlerTest, TestPseudoReturnFields, TestWordDelimiterFilterFactory, DefaultValueUpdateProcessorTest, SolrInfoBeanTest, DirectSolrSpellCheckerTest, TermsComponentTest, HighlighterConfigTest, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, ResponseLogComponentTest, SolrIndexConfigTest, BadComponentTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, SampleTest, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, OutputWriterTest, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, TestCodecSupport, TestPerFieldSimilarity, TestIBSimilarityFactory, TimeZoneUtilsTest, OpenExchangeRatesOrgProviderTest, DateMathParserTest, PreAnalyzedFieldTest, DOMUtilTest, ClusterStateTest, TestSolrJ, TestLRUCache, ZkNodePropsTest, SystemInfoHandlerTest, UUIDFieldTest, DistributedMLTComponentTest, CursorPagingTest, DistributedIntervalFacetingTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TokenizerChainTest, TestLuceneIndexBackCompat, AddReplicaTest, ChaosMonkeySafeLeaderWithPullReplicasTest, DistributedVersionInfoTest, LeaderFailoverAfterPartitionTest, MissingSegmentRecoveryTest, MoveReplicaTest, RecoveryAfterSoftCommitTest, RollingRestartTest, SaslZkACLProviderTest, SharedFSAutoReplicaFailoverTest, SolrCLIZkUtilsTest, SolrCloudExampleTest, TestCloudPivotFacet, TestClusterProperties, TestConfigSetsAPIExclusivity, TestLeaderElectionZkExpiry, TestLeaderInitiatedRecoveryThread, TestRandomFlRTGCloud, TlogReplayBufferedWhileIndexingTest, ZkFailoverTest, AutoAddReplicasPlanActionTest, HdfsAutoAddReplicasIntegrationTest, TestDistribStateManager, TestNodeAddedTrigger, TestNodeLostTrigger, TestTriggerIntegration, CdcrVersionReplicationTest, HdfsRecoveryZkTest, TestSolrCoreSnapshots, TestCoreBackup, TestReplicationHandlerBackup, TestReqParamsAPI, TestSolrConfigHandlerConcurrent, CoreAdminRequestStatusTest, MetricsHandlerTest, StatsReloadRaceTest, DistributedFacetPivotLargeTest, DistributedFacetPivotWhiteBoxTest, DistributedQueryComponentOptimizationTest, TestLegacyFieldReuse, TestLegacyNumericUtils, TestLegacyTerms, TestMultiValuedNumericRangeQuery, TestNumericRangeQuery32, SolrMetricReporterTest, SolrGangliaReporterTest, SolrJmxReporterCloudTest, SolrCloudReportersTest, JSONWriterTest, SmileWriterTest, TestCustomDocTransformer, TestPushWriter, TestRawResponseWriter, TestSolrQueryResponse, TestManagedResource, TestDynamicFieldCollectionResource, TestSchemaNameResource, TestSchemaSimilarityResource, BadCopyFieldTest, BooleanFieldTest, ChangedSchemaMergeTest, CurrencyFieldTypeTest, EnumFieldTest, ManagedSchemaRoundRobinCloudTest, TestHalfAndHalfDocValues, TestManagedSchema, TestManagedSchemaThreadSafety, TestSchemaManager, AnalyticsMergeStrategyTest, TestJsonFacetsWithNestedObjects, TestOrdValues, BJQParserTest, BlockJoinFacetDistribTest, TestCloudNestedDocsSort, TestPerFieldSimilarityWithDefaultOverride, TestDistribIDF, HttpSolrCallGetCoreTest, TestFileDictionaryLookup, BlockDirectoryTest, CdcrUpdateLogTest, TestDocBasedVersionConstraints, VersionInfoTest, AddSchemaFieldsUpdateProcessorFactoryTest, AtomicUpdateProcessorFactoryTest]
   [junit4] Completed [764/785 (1!)] on J0 in 0.60s, 4 tests, 1 error <<< FAILURES!

[...truncated 45226 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/14/consoleText

[repro] Revision: dea0fd3267689bbff045cde2762c9726096b3512

[repro] Repro line:  ant test  -Dtestcase=AtomicUpdateProcessorFactoryTest -Dtests.method=testMultipleThreads -Dtests.seed=6CC5D2B5633C4CE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr-ME -Dtests.timezone=America/Argentina/Jujuy -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       AtomicUpdateProcessorFactoryTest
[repro] ant compile-test

[...truncated 3314 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.AtomicUpdateProcessorFactoryTest" -Dtests.showOutput=onerror  -Dtests.seed=6CC5D2B5633C4CE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr-ME -Dtests.timezone=America/Argentina/Jujuy -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 86 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest
[repro] Exiting with code 0

[...truncated 40 lines...]

[JENKINS] Lucene-Solr-BadApples-7.x-Linux (64bit/jdk1.8.0_162) - Build # 13 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/13/
Java: 64bit/jdk1.8.0_162 -XX:-UseCompressedOops -XX:+UseG1GC

4 tests failed.
FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([F24042AEF1B0E162:DE7235237D7497E6]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:264)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=int_i:19&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 40 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([F24042AEF1B0E162:DE7235237D7497E6]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:260)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">1</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=cat:550e6x41haoczi1tu1kp+8m89b6oxusd59g0239su+l9s3gzohp1ydwjv779x6+qhhrrx91hl13p714a8vx+39yxcjn9o45ybcvzg808&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 40 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([F24042AEF1B0E162:DE7235237D7497E6]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:264)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=int_i:19&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 40 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([F24042AEF1B0E162:DE7235237D7497E6]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:264)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=int_i:19&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 40 more




Build Log:
[...truncated 1776 lines...]
   [junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/core/test/temp/junit4-J0-20180324_065504_0151523990062745877126.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] codec: DummyCompressingStoredFields, pf: LuceneFixedGap, dvf: Direct
   [junit4] <<< JVM J0: EOF ----

[...truncated 12878 lines...]
   [junit4] Suite: org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_F24042AEF1B0E162-001/init-core-data-001
   [junit4]   2> 2633537 WARN  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=17 numCloses=17
   [junit4]   2> 2633537 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2633538 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2633538 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2633539 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 2633539 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2633558 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 2633573 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 2633726 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2633803 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@527549c7
   [junit4]   2> 2633811 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@527549c7
   [junit4]   2> 2633811 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@527549c7
   [junit4]   2> 2633812 INFO  (coreLoadExecutor-12211-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2633813 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2633835 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 2633857 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 2633973 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2633979 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 2633980 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@527549c7
   [junit4]   2> 2633980 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2633980 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_F24042AEF1B0E162-001/init-core-data-001/]
   [junit4]   2> 2633981 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=30.576171875, floorSegmentMB=1.6884765625, forceMergeDeletesPctAllowed=18.41993174522107, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 2634021 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2634021 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2634023 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2634023 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2634023 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=38.7919921875, floorSegmentMB=0.5205078125, forceMergeDeletesPctAllowed=6.015001289942976, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 2634024 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@ba9129f[collection1] main]
   [junit4]   2> 2634024 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 2634041 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 2634123 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2634124 INFO  (searcherExecutor-12212-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 2634124 INFO  (coreLoadExecutor-12211-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1595805368936562688
   [junit4]   2> 2634124 INFO  (searcherExecutor-12212-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 2634124 INFO  (searcherExecutor-12212-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 2634124 INFO  (searcherExecutor-12212-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 2634124 INFO  (searcherExecutor-12212-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 2634125 INFO  (searcherExecutor-12212-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 2634125 INFO  (searcherExecutor-12212-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 2634125 INFO  (searcherExecutor-12212-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 2634125 INFO  (searcherExecutor-12212-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 2634126 INFO  (searcherExecutor-12212-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@ba9129f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2634127 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 2634129 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBasics
   [junit4]   2> 2634133 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595805368945999872,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2634133 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@aefad7d commitCommandVersion:1595805368945999872
   [junit4]   2> 2634135 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5f0ea79c[collection1] main]
   [junit4]   2> 2634136 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2634137 INFO  (searcherExecutor-12212-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5f0ea79c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.4.0):C1)))}
   [junit4]   2> 2634137 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 2634139 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634140 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:human&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634140 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Mr&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634140 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:20&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634140 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name_s:Virat&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634141 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=multiDefault:Delhi&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634142 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595805368955437056,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2634142 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@aefad7d commitCommandVersion:1595805368955437056
   [junit4]   2> 2634144 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5f8dec15[collection1] main]
   [junit4]   2> 2634145 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2634146 INFO  (searcherExecutor-12212-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5f8dec15[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(7.4.0):C1)))}
   [junit4]   2> 2634146 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 2634147 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634147 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:human&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634147 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:animal&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634148 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&indent=true&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634148 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Mr&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2634148 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Dr&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634149 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:20&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2634149 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:40&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634149 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name_s:Virat&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2634149 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=multiDefault:Delhi&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2634150 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBasics
   [junit4]   2> 2634152 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMultipleThreads
   [junit4]   2> 2634152 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2634152 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5c214ba8[collection1] realtime]
   [junit4]   2> 2634153 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
   [junit4]   2> 2634162 WARN  (Thread-10436) [    ] o.a.s.u.p.AtomicUpdateProcessorFactory Atomic update failed due to version conflict for 10 expected=1595805368966971392 actual=1595805368976408576Retrying with new version .... (1)
   [junit4]   2> 2634162 WARN  (Thread-10437) [    ] o.a.s.u.p.AtomicUpdateProcessorFactory Atomic update failed due to version conflict for 10 expected=1595805368974311424 actual=1595805368976408576Retrying with new version .... (1)
   [junit4]   2> 2634163 WARN  (Thread-10435) [    ] o.a.s.u.p.AtomicUpdateProcessorFactory Atomic update failed due to version conflict for 10 expected=1595805368966971392 actual=1595805368976408576Retrying with new version .... (1)
   [junit4]   2> 2634164 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595805368978505728,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2634164 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@aefad7d commitCommandVersion:1595805368978505728
   [junit4]   2> 2634165 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@309d12f8[collection1] main]
   [junit4]   2> 2634166 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2634167 INFO  (searcherExecutor-12212-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@309d12f8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(7.4.0):C10/9:delGen=1)))}
   [junit4]   2> 2634168 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 2634168 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:10&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634169 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:550e6x41haoczi1tu1kp+8m89b6oxusd59g0239su+l9s3gzohp1ydwjv779x6+qhhrrx91hl13p714a8vx+39yxcjn9o45ybcvzg808&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 2634170 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=int_i:19&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2634170 ERROR (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=int_i:19&wt=xml
   [junit4]   2> 2634170 ERROR (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=int_i:19&wt=xml:java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=int_i:19&wt=xml
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
   [junit4]   2> 	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:264)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 2634171 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMultipleThreads
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=AtomicUpdateProcessorFactoryTest -Dtests.method=testMultipleThreads -Dtests.seed=F24042AEF1B0E162 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=uk -Dtests.timezone=US/Arizona -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.02s J0 | AtomicUpdateProcessorFactoryTest.testMultipleThreads <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F24042AEF1B0E162:DE7235237D7497E6]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
   [junit4]    > 	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:264)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]    > </response>
   [junit4]    > 	request was:q=int_i:19&wt=xml
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
   [junit4]    > 	... 40 more
   [junit4]   2> 2634174 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoUniqueIdPassed
   [junit4]   2> 2634174 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoUniqueIdPassed
   [junit4]   2> 2634176 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testWrongAtomicOpPassed
   [junit4]   2> 2634177 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testWrongAtomicOpPassed
   [junit4]   2> 2634177 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 2634177 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=410720814
   [junit4]   2> 2634177 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2634177 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5617b9b5: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@7e06b3ad
   [junit4]   2> 2634181 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2634181 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1c52f460: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1b174b84
   [junit4]   2> 2634185 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2634185 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@67753dcc: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@43dc0819
   [junit4]   2> 2634185 INFO  (coreCloseExecutor-12217-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@129f68c6
   [junit4]   2> 2634185 INFO  (coreCloseExecutor-12217-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=312436934
   [junit4]   2> 2634185 INFO  (coreCloseExecutor-12217-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1f7538ff: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@47db942f
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_F24042AEF1B0E162-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=true): {}, locale=uk, timezone=US/Arizona
   [junit4]   2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=145413288,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [OutputWriterTest, MissingSegmentRecoveryTest, ConfigureRecoveryStrategyTest, SpellCheckCollatorTest, TestPayloadCheckQParserPlugin, HdfsLockFactoryTest, SolrJmxReporterCloudTest, TestDFISimilarityFactory, PluginInfoTest, XmlUpdateRequestHandlerTest, TestCloudPseudoReturnFields, TestSchemaSimilarityResource, LeaderElectionContextKeyTest, TestCollectionsAPIViaSolrCloudCluster, ChaosMonkeyNothingIsSafeWithPullReplicasTest, RemoteQueryErrorTest, SegmentsInfoRequestHandlerTest, HdfsUnloadDistributedZkTest, TestDistribDocBasedVersion, AnalyticsMergeStrategyTest, TestStreamBody, TestPHPSerializedResponseWriter, TestReplicaProperties, TestSimpleQParserPlugin, DefaultValueUpdateProcessorTest, SolrPluginUtilsTest, FullSolrCloudDistribCmdsTest, JSONWriterTest, TestCSVResponseWriter, TestHighlightDedupGrouping, TestClusterStateProvider, TestNodeAddedTrigger, ClassificationUpdateProcessorTest, HdfsRecoverLeaseTest, TestAnalyzeInfixSuggestions, JavabinLoaderTest, TestManagedResourceStorage, BlockDirectoryTest, TestHashPartitioner, SuggestComponentTest, ZkShardTermsTest, AutoAddReplicasPlanActionTest, CdcrBidirectionalTest, TermVectorComponentDistributedTest, MoveReplicaTest, CreateRoutedAliasTest, TestConfigSetsAPIZkFailure, UUIDFieldTest, ReplicationFactorTest, DistributedFacetExistsSmallTest, CoreAdminRequestStatusTest, TestWriterPerf, StatsComponentTest, TestIBSimilarityFactory, TestExecutePlanAction, TestConfigSetProperties, TestSubQueryTransformerCrossCore, TestPullReplicaErrorHandling, MetricTriggerTest, LeaderVoteWaitTimeoutTest, TestNumericRangeQuery32, ExternalFileFieldSortTest, ShufflingReplicaListTransformerTest, TestScoreJoinQPNoScore, TestCollationField, TestStressUserVersions, TestExtendedDismaxParser, TestUniqueKeyFieldResource, TestSolrQueryParser, TestCustomSort, DirectUpdateHandlerTest, TestFieldCacheVsDocValues, DistribJoinFromCollectionTest, TestIndexingPerformance, TestCustomStream, TestGroupingSearch, CloudMLTQParserTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestOnReconnectListenerSupport, HDFSCollectionsAPITest, TestNRTOpen, TestInPlaceUpdatesDistrib, TestSimDistributedQueue, TestDocSet, ZkSolrClientTest, TestRawResponseWriter, TestCustomDocTransformer, SSLMigrationTest, TestComponentsName, CursorPagingTest, SimpleFacetsTest, MetricsHandlerTest, FieldAnalysisRequestHandlerTest, ConcurrentDeleteAndCreateCollectionTest, FacetPivotSmallTest, RankQueryTest, ScheduledMaintenanceTriggerTest, TestRebalanceLeaders, TestOrdValues, CleanupOldIndexTest, TestPointFields, ImplicitSnitchTest, TestNumericTerms32, TestDocumentBuilder, BlobRepositoryCloudTest, TestSlowCompositeReaderWrapper, TestClusterStateMutator, SolrIndexSplitterTest, SpellingQueryConverterTest, DistributedQueryElevationComponentTest, SolrCLIZkUtilsTest, TestPhraseSuggestions, TestAuthorizationFramework, V2StandaloneTest, TestQuerySenderNoQuery, TestCollapseQParserPlugin, TestFieldTypeResource, SolrCoreCheckLockOnStartupTest, TestSolrCloudSnapshots, SolrCoreMetricManagerTest, DocValuesNotIndexedTest, TokenizerChainTest, TestClusterProperties, TestExclusionRuleCollectionAccess, TestPseudoReturnFields, BasicDistributedZkTest, BasicDistributedZk2Test, UnloadDistributedZkTest, OpenCloseCoreStressTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, ClusterStateUpdateTest, TestRandomFaceting, TestZkChroot, ZkCLITest, ShardRoutingCustomTest, TestDistributedSearch, TestRecovery, ZkControllerTest, TestStressReorder, TestJoin, TestStressVersions, DistributedTermsComponentTest, TestCoreContainer, SolrCmdDistributorTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFiltering, BasicFunctionalityTest, TestLazyCores, TestIndexSearcher, ShowFileRequestHandlerTest, TestCoreDiscovery, SuggesterFSTTest, CoreAdminHandlerTest, SolrRequestParserTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTSTTest, SuggesterTest, TestStressLucene, SuggesterWFSTTest, TestCSVLoader, WordBreakSolrSpellCheckerTest, TestUpdate, TestWordDelimiterFilterFactory, QueryEqualityTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, TestRemoteStreaming, TestSolrDeletionPolicy1, SolrInfoBeanTest, XsltUpdateRequestHandlerTest, DebugComponentTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestOmitPositions, FileBasedSpellCheckerTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, MoreLikeThisHandlerTest, RequiredFieldsTest, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, ReturnFieldsTest, MBeansHandlerTest, PreAnalyzedFieldTest, TestSuggestSpellingConverter, DateFieldTest, RAMDirectoryFactoryTest, ClusterStateTest, TestSolrJ, TestLRUCache, TestUtils, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, DistributedMLTComponentTest, TestRTGBase, DistributedIntervalFacetingTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestSimpleTrackingShardHandler, TestTolerantSearch, TestLuceneIndexBackCompat, TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, ConnectionReuseTest, AddReplicaTest, AliasIntegrationTest, DistributedVersionInfoTest, LIROnShardRestartTest, LeaderFailureAfterFreshStartTest, PeerSyncReplicationTest, TestCloudPivotFacet, TestConfigSetsAPI, TestRandomFlRTGCloud, TestSkipOverseerOperations, TestSolrCloudWithDelegationTokens, TestSolrCloudWithSecureImpersonation, TestStressInPlaceUpdates, CollectionReloadTest, CollectionsAPIDistributedZkTest, TestHdfsCloudBackupRestore, AutoScalingHandlerTest, ExecutePlanActionTest, HttpTriggerListenerTest, SystemLogListenerTest, TestDistribStateManager, TestGenericDistributedQueue, TestTriggerIntegration, BaseCdcrDistributedZkTest, CdcrBootstrapTest, TestImplicitCoreProperties, TestInitParams, TestSimpleTextCodec, TestSolrXml, ResponseBuilderTest, TestBlobHandler, TestConfigReload, TestReplicationHandlerBackup, TestReqParamsAPI, TestSQLHandler, TestSolrConfigHandlerConcurrent, V2ApiIntegrationTest, TestApiFramework, TestCollectionAPIs, CustomHighlightComponentTest, DistributedFacetPivotLargeTest, DistributedFacetPivotSmallAdvancedTest, DistributedFacetPivotWhiteBoxTest, DistributedQueryComponentOptimizationTest, HighlighterMaxOffsetTest, UninvertDocValuesMergePolicyTest, CheckHdfsIndexTest, RegexBytesRefFilterTest, SubstringBytesRefFilterTest, TestMacroExpander, TestBinaryResponseWriter, TestGraphMLResponseWriter, TestJavabinTupleStreamParser, TestPushWriter, TestRawTransformer, TestManagedResource, TestCopyFieldCollectionResource, TestFieldCollectionResource, TestSchemaNameResource, TestManagedSynonymFilterFactory, BadCopyFieldTest, CurrencyFieldTypeTest, SpatialRPTFieldTypeTest, TestCloudManagedSchema, CursorMarkTest, TestAddFieldRealTimeGet, TestComplexPhraseLeadingWildcard, TestComplexPhraseQParserPlugin, TestFieldSortValues, TestGraphTermsQParserPlugin, TestHashQParserPlugin, TestMissingGroups, TestRecoveryHdfs, BJQParserTest, BlockJoinFacetDistribTest, TestNestedDocsSort, TestScoreJoinQPScore, TestJsonRequest, TestDistribIDF, BasicAuthIntegrationTest, HttpSolrCallGetCoreTest, TestDocTermOrds, TestFieldCacheReopen, TestFieldCacheSortRandom, AddBlockUpdateTest, DataDrivenBlockJoinTest, TestDocBasedVersionConstraints, VersionInfoTest, AddSchemaFieldsUpdateProcessorFactoryTest, AtomicUpdateProcessorFactoryTest]
   [junit4] Completed [763/784 (1!)] on J0 in 0.67s, 4 tests, 1 error <<< FAILURES!

[...truncated 49612 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/13/consoleText

[repro] Revision: bf33c0a4c0d518a2afd4e06acff06931a61ef16c

[repro] Repro line:  ant test  -Dtestcase=AtomicUpdateProcessorFactoryTest -Dtests.method=testMultipleThreads -Dtests.seed=F24042AEF1B0E162 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=uk -Dtests.timezone=US/Arizona -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       AtomicUpdateProcessorFactoryTest
[repro] ant compile-test

[...truncated 3314 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.AtomicUpdateProcessorFactoryTest" -Dtests.showOutput=onerror  -Dtests.seed=F24042AEF1B0E162 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=uk -Dtests.timezone=US/Arizona -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 32 lines...]
   [junit4] Suite: org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_F24042AEF1B0E162-001/init-core-data-001
   [junit4]   2> 0    INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 56   INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.e.j.u.log Logging initialized @2062ms to org.eclipse.jetty.util.log.Slf4jLog
   [junit4]   2> 64   INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 75   INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 109  INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 227  INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.SolrResourceLoader Using system property solr.solr.home: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr
   [junit4]   2> 237  INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 644  INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 914  INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 1447 WARN  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.WordDelimiterFilterFactory]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 1533 WARN  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.GeoHashField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 1539 WARN  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.LatLonType]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 1549 WARN  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.CurrencyField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 1740 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2661 WARN  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 2662 WARN  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 2662 WARN  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 2681 INFO  (coreLoadExecutor-6-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2685 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2762 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 2846 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 3035 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 3079 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 3159 WARN  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 3166 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 3174 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_F24042AEF1B0E162-001/init-core-data-001/]
   [junit4]   2> 3237 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=30.576171875, floorSegmentMB=1.6884765625, forceMergeDeletesPctAllowed=18.41993174522107, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 3386 WARN  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.OldLuceneQParserPlugin]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 4275 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 4275 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 4289 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 4289 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 4296 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=38.7919921875, floorSegmentMB=0.5205078125, forceMergeDeletesPctAllowed=6.015001289942976, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 4323 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@57edec78[collection1] main]
   [junit4]   2> 4469 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 4579 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 4777 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 5007 INFO  (searcherExecutor-7-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 5018 INFO  (searcherExecutor-7-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 5018 INFO  (searcherExecutor-7-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 5018 INFO  (searcherExecutor-7-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 5020 INFO  (coreLoadExecutor-6-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1595806326736289792
   [junit4]   2> 5022 INFO  (searcherExecutor-7-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 5030 INFO  (searcherExecutor-7-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 5033 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 5033 INFO  (searcherExecutor-7-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 5034 INFO  (searcherExecutor-7-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 5034 INFO  (searcherExecutor-7-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 5047 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBasics
   [junit4]   2> 5058 INFO  (searcherExecutor-7-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@57edec78[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 5290 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595806327019405312,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 5290 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3e3915ee commitCommandVersion:1595806327019405312
   [junit4]   2> 5472 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@20cdbe73[collection1] main]
   [junit4]   2> 5478 INFO  (searcherExecutor-7-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@20cdbe73[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.4.0):C1)))}
   [junit4]   2> 5479 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 5480 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 279
   [junit4]   2> 5556 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=1 status=0 QTime=66
   [junit4]   2> 5569 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:human&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 5571 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Mr&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 5578 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:20&wt=xml} hits=1 status=0 QTime=4
   [junit4]   2> 5580 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name_s:Virat&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 5582 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=multiDefault:Delhi&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 5611 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595806327355998208,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 5612 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3e3915ee commitCommandVersion:1595806327355998208
   [junit4]   2> 5633 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b263f7d[collection1] main]
   [junit4]   2> 5635 INFO  (searcherExecutor-7-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3b263f7d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(7.4.0):C1)))}
   [junit4]   2> 5638 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 5638 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 27
   [junit4]   2> 5642 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=1 status=0 QTime=3
   [junit4]   2> 5648 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:human&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 5649 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:animal&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 5655 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&indent=true&wt=xml} hits=1 status=0 QTime=4
   [junit4]   2> 5657 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Mr&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 5658 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Dr&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 5669 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:20&wt=xml} hits=0 status=0 QTime=10
   [junit4]   2> 5671 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:40&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 5672 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name_s:Virat&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 5673 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=multiDefault:Delhi&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 5674 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBasics
   [junit4] OK      0.64s J1 | AtomicUpdateProcessorFactoryTest.testBasics
   [junit4]   2> 5679 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMultipleThreads
   [junit4]   2> 5685 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 5687 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@220a16d3[collection1] realtime]
   [junit4]   2> 5687 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 7
   [junit4]   2> 5718 WARN  (Thread-11) [    ] o.a.s.u.p.AtomicUpdateProcessorFactory Atomic update failed due to version conflict for 10 expected=1595806327443030016 actual=1595806327467147264Retrying with new version .... (1)
   [junit4]   2> 5718 WARN  (Thread-10) [    ] o.a.s.u.p.AtomicUpdateProcessorFactory Atomic update failed due to version conflict for 10 expected=1595806327443030016 actual=1595806327467147264Retrying with new version .... (1)
   [junit4]   2> 5722 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595806327472390144,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 5722 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3e3915ee commitCommandVersion:1595806327472390144
   [junit4]   2> 5734 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7e2dd119[collection1] main]
   [junit4]   2> 5736 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 5736 INFO  (searcherExecutor-7-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7e2dd119[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(7.4.0):C10/9:delGen=1)))}
   [junit4]   2> 5737 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 14
   [junit4]   2> 5738 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:10&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 5768 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:550e6x41haoczi1tu1kp+8m89b6oxusd59g0239su+l9s3gzohp1ydwjv779x6+qhhrrx91hl13p714a8vx+39yxcjn9o45ybcvzg808&wt=xml} hits=1 status=0 QTime=11
   [junit4]   2> 5769 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=int_i:19&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 5770 ERROR (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=int_i:19&wt=xml
   [junit4]   2> 5771 ERROR (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=int_i:19&wt=xml:java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=int_i:19&wt=xml
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
   [junit4]   2> 	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:264)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 5771 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMultipleThreads
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=AtomicUpdateProcessorFactoryTest -Dtests.method=testMultipleThreads -Dtests.seed=F24042AEF1B0E162 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=uk -Dtests.timezone=US/Arizona -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.10s J1 | AtomicUpdateProcessorFactoryTest.testMultipleThreads <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F24042AEF1B0E162:DE7235237D7497E6]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
   [junit4]    > 	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:264)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]    > </response>
   [junit4]    > 	request was:q=int_i:19&wt=xml
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
   [junit4]    > 	... 40 more
   [junit4]   2> 5778 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoUniqueIdPassed
   [junit4]   2> 5778 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoUniqueIdPassed
   [junit4] OK      0.00s J1 | AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed
   [junit4]   2> 5782 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testWrongAtomicOpPassed
   [junit4]   2> 5782 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testWrongAtomicOpPassed
   [junit4] OK      0.00s J1 | AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed
   [junit4]   2> 5783 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 5783 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=686867626
   [junit4]   2> 5783 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 5784 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@728311be: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / null
   [junit4]   2> 5784 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 5784 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@76727ae5: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / null
   [junit4]   2> 5784 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 5784 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@57994c4c: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / null
   [junit4]   2>

[...truncated too long message...]

t4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 7423 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMultipleThreads
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=AtomicUpdateProcessorFactoryTest -Dtests.method=testMultipleThreads -Dtests.seed=F24042AEF1B0E162 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=uk -Dtests.timezone=US/Arizona -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.08s J1 | AtomicUpdateProcessorFactoryTest.testMultipleThreads <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F24042AEF1B0E162:DE7235237D7497E6]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
   [junit4]    > 	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:264)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]    > </response>
   [junit4]    > 	request was:q=int_i:19&wt=xml
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
   [junit4]    > 	... 40 more
   [junit4]   2> 7425 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoUniqueIdPassed
   [junit4]   2> 7425 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoUniqueIdPassed
   [junit4] OK      0.00s J1 | AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed
   [junit4]   2> 7426 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testWrongAtomicOpPassed
   [junit4]   2> 7427 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[F24042AEF1B0E162]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testWrongAtomicOpPassed
   [junit4] OK      0.00s J1 | AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed
   [junit4]   2> 7427 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 7427 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=861724965
   [junit4]   2> 7427 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 7427 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6ddf970c: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / null
   [junit4]   2> 7427 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 7427 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@63f6c15: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / null
   [junit4]   2> 7428 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 7428 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[F24042AEF1B0E162]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@68a176d7: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / null
   [junit4]   2> 7428 INFO  (coreCloseExecutor-25-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7bc95630
   [junit4]   2> 7428 INFO  (coreCloseExecutor-25-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=2076792368
   [junit4]   2> 7428 INFO  (coreCloseExecutor-25-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5a0605b6: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / null
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_F24042AEF1B0E162-002
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=true): {}, locale=uk, timezone=US/Arizona
   [junit4]   2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=231916784,total=365953024
   [junit4]   2> NOTE: All tests run in this JVM: [AtomicUpdateProcessorFactoryTest, AtomicUpdateProcessorFactoryTest]
   [junit4] Completed [5/5 (5!)] on J1 in 1.35s, 4 tests, 1 error <<< FAILURES!

[...truncated 15 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 20 tests, 5 errors [seed: F24042AEF1B0E162]

Total time: 11 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=bf33c0a4c0d518a2afd4e06acff06931a61ef16c, workspace=/var/lib/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #12
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-BadApples-7.x-Linux (32bit/jdk1.8.0_162) - Build # 12 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/12/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseParallelGC

6 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest

Error Message:
ObjectTracker found 1 object(s) that were not released!!! [ZkController] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:448)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:113)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:519)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:263)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:183)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:139)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:741)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1474)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1537)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1183)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1020)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:447)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:308)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:396)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:369)  at org.apache.solr.cloud.ChaosMonkey.start(ChaosMonkey.java:653)  at org.apache.solr.cloud.BasicDistributedZkTest.testStopAndStartCoresInOneInstance(BasicDistributedZkTest.java:561)  at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:381)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at java.lang.Thread.run(Thread.java:748)  

Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [ZkController]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.cloud.ZkController.<init>(ZkController.java:448)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:113)
	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:519)
	at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:263)
	at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:183)
	at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:139)
	at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:741)
	at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1474)
	at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1537)
	at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1183)
	at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1020)
	at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:447)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:308)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:396)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:369)
	at org.apache.solr.cloud.ChaosMonkey.start(ChaosMonkey.java:653)
	at org.apache.solr.cloud.BasicDistributedZkTest.testStopAndStartCoresInOneInstance(BasicDistributedZkTest.java:561)
	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:381)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


	at __randomizedtesting.SeedInfo.seed([AAF8845FA959DD2D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:301)
	at sun.reflect.GeneratedMethodAccessor38.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([AAF8845FA959DD2D:86CAF3D2259DABA9]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:260)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=int_i:21&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 40 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([AAF8845FA959DD2D:86CAF3D2259DABA9]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:260)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=int_i:21&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 40 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([AAF8845FA959DD2D:86CAF3D2259DABA9]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:260)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=int_i:21&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 40 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([AAF8845FA959DD2D:86CAF3D2259DABA9]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:260)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=int_i:21&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 40 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([AAF8845FA959DD2D:86CAF3D2259DABA9]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:260)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=int_i:21&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 40 more




Build Log:
[...truncated 1685 lines...]
   [junit4] JVM J2: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/core/test/temp/junit4-J2-20180322_060052_3665716711576645900773.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] codec: DummyCompressingStoredFields, pf: LuceneVarGapDocFreqInterval, dvf: Direct
   [junit4] <<< JVM J2: EOF ----

[...truncated 11091 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/init-core-data-001
   [junit4]   2> 514400 WARN  (SUITE-BasicDistributedZkTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 514401 INFO  (SUITE-BasicDistributedZkTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 514402 INFO  (SUITE-BasicDistributedZkTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 514402 INFO  (SUITE-BasicDistributedZkTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 514402 INFO  (SUITE-BasicDistributedZkTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /a/tb
   [junit4]   2> 514404 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 514405 INFO  (Thread-2811) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 514405 INFO  (Thread-2811) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 514410 ERROR (Thread-2811) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 514505 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.ZkTestServer start zk server on port:44499
   [junit4]   2> 514512 INFO  (zkConnectionManagerCallback-1224-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 514518 INFO  (zkConnectionManagerCallback-1226-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 514524 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 514525 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 514527 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 514528 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 514530 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 514531 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 514532 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 514533 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 514534 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 514535 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 514536 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 514538 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 514626 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T06:27:37+09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 514627 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 514627 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 514627 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 514627 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@cf5df1{/a/tb,null,AVAILABLE}
   [junit4]   2> 514628 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@8436db{HTTP/1.1,[http/1.1]}{127.0.0.1:44851}
   [junit4]   2> 514628 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.Server Started @515807ms
   [junit4]   2> 514629 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/tempDir-001/control/data, hostContext=/a/tb, hostPort=44851, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/control-001/cores}
   [junit4]   2> 514629 ERROR (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 514629 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.4.0
   [junit4]   2> 514629 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 514629 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 514629 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-22T06:35:34.459Z
   [junit4]   2> 514631 INFO  (zkConnectionManagerCallback-1228-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 514632 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 514632 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/control-001/solr.xml
   [junit4]   2> 514638 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 514638 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 514639 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6a15cc, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 514642 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44499/solr
   [junit4]   2> 514644 INFO  (zkConnectionManagerCallback-1232-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 514647 INFO  (zkConnectionManagerCallback-1234-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 514710 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 514711 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44851_a%2Ftb
   [junit4]   2> 514711 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.Overseer Overseer (id=72178058468130820-127.0.0.1:44851_a%2Ftb-n_0000000000) starting
   [junit4]   2> 514717 INFO  (zkConnectionManagerCallback-1239-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 514718 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44499/solr ready
   [junit4]   2> 514719 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44851_a%2Ftb
   [junit4]   2> 514720 INFO  (zkCallback-1238-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 514720 INFO  (zkCallback-1233-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 515216 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a15cc
   [junit4]   2> 515227 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a15cc
   [junit4]   2> 515227 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a15cc
   [junit4]   2> 515229 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/control-001/cores
   [junit4]   2> 515249 INFO  (zkConnectionManagerCallback-1243-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 515250 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 515250 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44499/solr ready
   [junit4]   2> 515252 INFO  (qtp25932991-6884) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44851_a%252Ftb&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 515255 INFO  (OverseerThreadFactory-1964-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 515361 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 515361 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 515466 INFO  (zkCallback-1233-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 516383 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 516398 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 516493 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 516509 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 516510 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a15cc
   [junit4]   2> 516511 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 516511 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 516515 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=40, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 516517 WARN  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 516573 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 516573 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 516574 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 516574 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 516576 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=25.78125, floorSegmentMB=1.0224609375, forceMergeDeletesPctAllowed=29.077219368307514, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 516576 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@11ad9b8[control_collection_shard1_replica_n1] main]
   [junit4]   2> 516577 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 516578 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 516578 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 516580 INFO  (searcherExecutor-1967-thread-1-processing-n:127.0.0.1:44851_a%2Ftb x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@11ad9b8[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 516580 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1595618661666652160
   [junit4]   2> 516586 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 516588 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 516588 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 516588 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44851/a/tb/control_collection_shard1_replica_n1/
   [junit4]   2> 516588 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 516588 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:44851/a/tb/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 516588 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 516590 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44851/a/tb/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 516692 INFO  (zkCallback-1233-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 516741 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 516786 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1425
   [junit4]   2> 516789 INFO  (qtp25932991-6884) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 516844 INFO  (zkCallback-1233-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 517256 INFO  (OverseerCollectionConfigSetProcessor-72178058468130820-127.0.0.1:44851_a%2Ftb-n_0000000000) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 517789 INFO  (qtp25932991-6884) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44851_a%252Ftb&wt=javabin&version=2} status=0 QTime=2536
   [junit4]   2> 517793 INFO  (zkConnectionManagerCallback-1247-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 517794 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 517796 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44499/solr ready
   [junit4]   2> 517796 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 517797 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 517799 INFO  (OverseerThreadFactory-1964-thread-2-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 517799 WARN  (OverseerThreadFactory-1964-thread-2-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 518004 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 518004 INFO  (qtp25932991-6890) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=207
   [junit4]   2> 518081 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/shard-1-001 of type NRT
   [junit4]   2> 518081 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T06:27:37+09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 518082 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 518082 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 518082 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 518082 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@c6601{/a/tb,null,AVAILABLE}
   [junit4]   2> 518083 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1364354{HTTP/1.1,[http/1.1]}{127.0.0.1:34471}
   [junit4]   2> 518083 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.Server Started @519262ms
   [junit4]   2> 518083 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/a/tb, hostPort=34471, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/shard-1-001/cores}
   [junit4]   2> 518083 ERROR (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 518084 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.4.0
   [junit4]   2> 518084 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 518084 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 518084 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-22T06:35:37.914Z
   [junit4]   2> 518086 INFO  (zkConnectionManagerCallback-1249-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 518087 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 518087 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/shard-1-001/solr.xml
   [junit4]   2> 518091 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 518091 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 518092 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6a15cc, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 518094 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44499/solr
   [junit4]   2> 518095 INFO  (zkConnectionManagerCallback-1253-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 518097 INFO  (zkConnectionManagerCallback-1255-thread-1-processing-n:127.0.0.1:34471_a%2Ftb) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 518101 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 518102 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 518103 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34471_a%2Ftb
   [junit4]   2> 518104 INFO  (zkCallback-1233-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 518104 INFO  (zkCallback-1246-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 518104 INFO  (zkCallback-1238-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 518106 INFO  (zkCallback-1254-thread-1-processing-n:127.0.0.1:34471_a%2Ftb) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 518723 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a15cc
   [junit4]   2> 518734 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a15cc
   [junit4]   2> 518735 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a15cc
   [junit4]   2> 518736 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/shard-1-001/cores
   [junit4]   2> 518739 INFO  (zkConnectionManagerCallback-1260-thread-1-processing-n:127.0.0.1:34471_a%2Ftb) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 518740 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 518741 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44499/solr ready
   [junit4]   2> 518769 INFO  (qtp32942542-6940) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:34471_a%252Ftb&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 518771 INFO  (OverseerCollectionConfigSetProcessor-72178058468130820-127.0.0.1:44851_a%2Ftb-n_0000000000) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 518771 INFO  (OverseerThreadFactory-1964-thread-3-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:34471_a%2Ftb for creating new replica
   [junit4]   2> 518774 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 518774 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 519788 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 519800 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
   [junit4]   2> 519889 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 519903 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
   [junit4]   2> 519903 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a15cc
   [junit4]   2> 519903 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 519904 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
   [junit4]   2> 519906 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=40, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 519909 WARN  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 519953 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 519953 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 519954 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 519954 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 519955 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=25.78125, floorSegmentMB=1.0224609375, forceMergeDeletesPctAllowed=29.077219368307514, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 519955 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@556b4[collection1_shard2_replica_n41] main]
   [junit4]   2> 519957 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 519958 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 519958 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 519960 INFO  (searcherExecutor-1978-thread-1-processing-n:127.0.0.1:34471_a%2Ftb x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@556b4[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 519960 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1595618665210839040
   [junit4]   2> 519966 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node42=0}, version=0}
   [junit4]   2> 519968 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 519968 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 519968 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34471/a/tb/collection1_shard2_replica_n41/
   [junit4]   2> 519968 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 519968 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:34471/a/tb/collection1_shard2_replica_n41/ has no replicas
   [junit4]   2> 519968 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 519970 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34471/a/tb/collection1_shard2_replica_n41/ shard2
   [junit4]   2> 520121 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 520123 INFO  (qtp32942542-6946) [n:127.0.0.1:34471_a%2Ftb c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1349
   [junit4]   2> 520126 INFO  (qtp32942542-6940) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:34471_a%252Ftb&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1357
   [junit4]   2> 520207 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/shard-2-001 of type NRT
   [junit4]   2> 520208 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T06:27:37+09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 520208 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 520208 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 520208 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 520209 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1edcb7a{/a/tb,null,AVAILABLE}
   [junit4]   2> 520209 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1b0bd2f{HTTP/1.1,[http/1.1]}{127.0.0.1:46171}
   [junit4]   2> 520209 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.e.j.s.Server Started @521388ms
   [junit4]   2> 520209 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/a/tb, hostPort=46171, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/shard-2-001/cores}
   [junit4]   2> 520210 ERROR (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 520210 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.4.0
   [junit4]   2> 520210 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 520210 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 520210 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-22T06:35:40.040Z
   [junit4]   2> 520211 INFO  (zkConnectionManagerCallback-1262-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 520212 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 520212 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_AAF8845FA959DD2D-001/shard-2-001/solr.xml
   [junit4]   2> 520216 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 520216 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 520217 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6a15cc, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 520219 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44499/solr
   [junit4]   2> 520220 INFO  (zkConnectionManagerCallback-1266-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 520223 INFO  (zkConnectionManagerCallback-1268-thread-1-processing-n:127.0.0.1:46171_a%2Ftb) [n:127.0.0.1:46171_a%2Ftb    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 520226 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:46171_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 520227 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:46171_a%2Ftb    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 520229 INFO  (TEST-BasicDistributedZkTest.test-seed#[AAF8845FA959DD2D]) [n:127.0.0.1:46171_a%2Ftb    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46171_a%2Ftb
   [junit4]   2> 520230 INFO  (zkCallback-1233-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 520230 INFO  (zkCallback-1246-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 520230 INFO  (zkCallback-1259-thread-1-processing-n:127.0.0.1:34471_a%2Ftb) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 520230 INFO  (zkCallback-1254-thread-1-processing-n:127.0.0.1:34471_a%2Ftb) [n:127.0.0.1:34471_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 520230 INFO  (zkCallback-1238-thread-1-processing-n:127.0.0.1:44851_a%2Ftb) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 520232 INFO  (zkCallback-1267-thread-1-processing-n:127.0.0.1:46171_a%2Ftb) [n:127.0.0.1:46171_a%2Ftb    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 520773 INFO  (OverseerCollectionConfigSetProcessor-72178058468130820-127.0.0.1:44851_a%2Ftb-n_0000000000) [n:127.0.0.1:44851_a%2Ftb    ] o.a.s.c.Ove

[...truncated too long message...]

r.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 94236 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[AAF8845FA959DD2D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMultipleThreads
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=AtomicUpdateProcessorFactoryTest -Dtests.method=testMultipleThreads -Dtests.seed=AAF8845FA959DD2D -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sq -Dtests.timezone=CST6CDT -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.04s J0 | AtomicUpdateProcessorFactoryTest.testMultipleThreads <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([AAF8845FA959DD2D:86CAF3D2259DABA9]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
   [junit4]    > 	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:260)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]    > </response>
   [junit4]    > 	request was:q=int_i:21&wt=xml
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
   [junit4]    > 	... 40 more
   [junit4]   2> 94236 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 94236 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=32239376
   [junit4]   2> 94237 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 94237 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ede574: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1194f4c
   [junit4]   2> 94239 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 94240 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1aa28d8: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@c33c09
   [junit4]   2> 94242 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 94242 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[AAF8845FA959DD2D]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@135a0f9: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@13f9bd
   [junit4]   2> 94242 INFO  (coreCloseExecutor-282-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6fb91d
   [junit4]   2> 94242 INFO  (coreCloseExecutor-282-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=7321885
   [junit4]   2> 94242 INFO  (coreCloseExecutor-282-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ca4e3b: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@1751bac
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_AAF8845FA959DD2D-002
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {name_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), int_i=FSTOrd50, range_facet_l_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), multiDefault=PostingsFormat(name=LuceneFixedGap), intDefault=Lucene50(blocksize=128), title=Lucene50(blocksize=128), title_lettertok=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), count_i=FSTOrd50, range_facet_l=PostingsFormat(name=LuceneFixedGap), title_stringNoNorms=PostingsFormat(name=LuceneFixedGap), title_stemmed=Lucene50(blocksize=128), cat=PostingsFormat(name=LuceneFixedGap), id_i1=Lucene50(blocksize=128), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_i_dv=PostingsFormat(name=LuceneFixedGap), text=FSTOrd50, timestamp=PostingsFormat(name=LuceneFixedGap)}, docValues:{int_i=DocValuesFormat(name=Lucene70), range_facet_l_dv=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Lucene70), intDefault=DocValuesFormat(name=Lucene70), id_i1=DocValuesFormat(name=Lucene70), range_facet_i_dv=DocValuesFormat(name=Memory), intDvoDefault=DocValuesFormat(name=Asserting), count_i=DocValuesFormat(name=Lucene70), timestamp=DocValuesFormat(name=Memory), range_facet_l=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=908, maxMBSortInHeap=6.618546944544427, sim=RandomSimilarity(queryNorm=false): {}, locale=sq, timezone=CST6CDT
   [junit4]   2> NOTE: Linux 4.13.0-36-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=21627576,total=343146496
   [junit4]   2> NOTE: All tests run in this JVM: [BasicDistributedZkTest, AtomicUpdateProcessorFactoryTest, AtomicUpdateProcessorFactoryTest]
   [junit4] Completed [8/10 (4!)] on J0 in 0.99s, 4 tests, 1 error <<< FAILURES!

[...truncated 24 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 10 suites, 25 tests, 4 errors [seed: AAF8845FA959DD2D]

Total time: 2 minutes 47 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.BasicDistributedZkTest
[repro]   4/5 failed: org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=bd6cf168e0e129fa22545a7f614b2b146bd5f202, workspace=/var/lib/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #11
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-EA] Lucene-Solr-BadApples-7.x-Linux (64bit/jdk-10-ea+43) - Build # 11 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/11/
Java: 64bit/jdk-10-ea+43 -XX:-UseCompressedOops -XX:+UseG1GC

11 tests failed.
FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:36703/solr/MoveReplicaHDFSTest_failed_coll_true, http://127.0.0.1:45443/solr/MoveReplicaHDFSTest_failed_coll_true]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:36703/solr/MoveReplicaHDFSTest_failed_coll_true, http://127.0.0.1:45443/solr/MoveReplicaHDFSTest_failed_coll_true]
	at __randomizedtesting.SeedInfo.seed([178282F9A056ADDD:BD4F510B1785780D]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:462)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1105)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:885)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:992)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:818)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:308)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45443/solr/MoveReplicaHDFSTest_failed_coll_true: no servers hosting shard: shard1
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:436)
	... 45 more


FAILED:  org.apache.solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete

Error Message:
Error from server at http://127.0.0.1:45343/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> <title>Error 404 Can not find: /solr/testcollection_shard1_replica_n2/update</title> </head> <body><h2>HTTP ERROR 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason: <pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.8.v20171121</a><hr/>  </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:45343/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/testcollection_shard1_replica_n2/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.8.v20171121</a><hr/>

</body>
</html>

	at __randomizedtesting.SeedInfo.seed([178282F9A056ADDD:B4782C5C27BE4778]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:551)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1014)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:885)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:947)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:947)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:947)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:947)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:947)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:818)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
	at org.apache.solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete(TestCollectionsAPIViaSolrCloudCluster.java:170)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45343/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/testcollection_shard1_replica_n2/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.8.v20171121</a><hr/>

</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:528)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([178282F9A056ADDD:3BB0F5742C92DB59]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">1</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=cat:stz3btky9qhc9ukvfqvb+cwgra9szrrtw60kiqy4a+pxxjcybysv0r0y7t98du+qunl5s52davi0jh0qz6g+poatd7bhd9ehf3ukmu0j&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 39 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([178282F9A056ADDD:3BB0F5742C92DB59]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=cat:stz3btky9qhc9ukvfqvb+cwgra9szrrtw60kiqy4a+pxxjcybysv0r0y7t98du+qunl5s52davi0jh0qz6g+poatd7bhd9ehf3ukmu0j&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 39 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([178282F9A056ADDD:3BB0F5742C92DB59]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=cat:stz3btky9qhc9ukvfqvb+cwgra9szrrtw60kiqy4a+pxxjcybysv0r0y7t98du+qunl5s52davi0jh0qz6g+poatd7bhd9ehf3ukmu0j&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 39 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([178282F9A056ADDD:3BB0F5742C92DB59]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">5</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=cat:stz3btky9qhc9ukvfqvb+cwgra9szrrtw60kiqy4a+pxxjcybysv0r0y7t98du+qunl5s52davi0jh0qz6g+poatd7bhd9ehf3ukmu0j&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 39 more


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([178282F9A056ADDD:3BB0F5742C92DB59]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=cat:stz3btky9qhc9ukvfqvb+cwgra9szrrtw60kiqy4a+pxxjcybysv0r0y7t98du+qunl5s52davi0jh0qz6g+poatd7bhd9ehf3ukmu0j&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
	... 39 more


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([168710F80ABDFBD2:E72662A83F063140]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([168710F80ABDFBD2:E72662A83F063140]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([168710F80ABDFBD2:E72662A83F063140]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([168710F80ABDFBD2:E72662A83F063140]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1773 lines...]
   [junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/core/test/temp/junit4-J0-20180320_053005_0869058353419361818176.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] codec: FastCompressingStoredFields, pf: LuceneVarGapFixedInterval, dvf: Memory
   [junit4] <<< JVM J0: EOF ----

[...truncated 10850 lines...]
   [junit4] Suite: org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest
   [junit4]   2> 532160 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_178282F9A056ADDD-001/init-core-data-001
   [junit4]   2> 532161 WARN  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=17 numCloses=17
   [junit4]   2> 532161 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 532161 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 532162 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 532162 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 532176 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 532188 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 532257 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 532284 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d44934
   [junit4]   2> 532291 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d44934
   [junit4]   2> 532291 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d44934
   [junit4]   2> 532292 INFO  (coreLoadExecutor-1747-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 532292 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 532307 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 532319 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 532376 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 532383 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 532383 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d44934
   [junit4]   2> 532383 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 532383 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_178282F9A056ADDD-001/init-core-data-001/]
   [junit4]   2> 532384 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=58.6123046875, floorSegmentMB=0.2373046875, forceMergeDeletesPctAllowed=27.148332599173717, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3372713412913114
   [junit4]   2> 532415 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 532415 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 532421 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 532421 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 532422 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=357583116, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 532422 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@15d3ffaf[collection1] main]
   [junit4]   2> 532423 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 532442 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 532558 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 532558 INFO  (searcherExecutor-1748-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 532558 INFO  (coreLoadExecutor-1747-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1595435457205764096
   [junit4]   2> 532558 INFO  (searcherExecutor-1748-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 532558 INFO  (searcherExecutor-1748-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 532558 INFO  (searcherExecutor-1748-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 532558 INFO  (searcherExecutor-1748-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 532559 INFO  (searcherExecutor-1748-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 532559 INFO  (searcherExecutor-1748-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 532559 INFO  (searcherExecutor-1748-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 532559 INFO  (searcherExecutor-1748-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 532560 INFO  (searcherExecutor-1748-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@15d3ffaf[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 532560 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 532562 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[178282F9A056ADDD]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testWrongAtomicOpPassed
   [junit4]   2> 532562 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[178282F9A056ADDD]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testWrongAtomicOpPassed
   [junit4]   2> 532564 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBasics
   [junit4]   2> 532566 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595435457214152704,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 532566 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6ffdb67f commitCommandVersion:1595435457214152704
   [junit4]   2> 532572 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@527e7561[collection1] main]
   [junit4]   2> 532572 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 532573 INFO  (searcherExecutor-1748-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@527e7561[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.4.0):C1)))}
   [junit4]   2> 532573 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 7
   [junit4]   2> 532575 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532575 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:human&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532575 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Mr&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532576 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:20&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532576 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name_s:Virat&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532576 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=multiDefault:Delhi&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532578 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595435457226735616,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 532578 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6ffdb67f commitCommandVersion:1595435457226735616
   [junit4]   2> 532581 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@ab8eda0[collection1] main]
   [junit4]   2> 532581 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 532582 INFO  (searcherExecutor-1748-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@ab8eda0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(7.4.0):C1)))}
   [junit4]   2> 532582 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 532583 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532583 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:human&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532583 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:animal&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532583 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Mr&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 532584 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=title:Dr&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532584 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:20&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 532584 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=count_i:40&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532584 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name_s:Virat&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 532584 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=multiDefault:Delhi&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 532584 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[178282F9A056ADDD]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBasics
   [junit4]   2> 532586 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[178282F9A056ADDD]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoUniqueIdPassed
   [junit4]   2> 532586 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[178282F9A056ADDD]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoUniqueIdPassed
   [junit4]   2> 532587 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMultipleThreads
   [junit4]   2> 532587 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 532587 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6dc5901b[collection1] realtime]
   [junit4]   2> 532587 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
   [junit4]   2> 532603 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1595435457252950019,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 532603 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6ffdb67f commitCommandVersion:1595435457252950019
   [junit4]   2> 532606 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2f0be4c5[collection1] main]
   [junit4]   2> 532606 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 532608 INFO  (searcherExecutor-1748-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2f0be4c5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(7.4.0):C10/9:delGen=1)))}
   [junit4]   2> 532608 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 532608 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:10&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 532609 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=cat:stz3btky9qhc9ukvfqvb+cwgra9szrrtw60kiqy4a+pxxjcybysv0r0y7t98du+qunl5s52davi0jh0qz6g+poatd7bhd9ehf3ukmu0j&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 532609 ERROR (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=cat:stz3btky9qhc9ukvfqvb+cwgra9szrrtw60kiqy4a+pxxjcybysv0r0y7t98du+qunl5s52davi0jh0qz6g+poatd7bhd9ehf3ukmu0j&wt=xml
   [junit4]   2> 532609 ERROR (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=cat:stz3btky9qhc9ukvfqvb+cwgra9szrrtw60kiqy4a+pxxjcybysv0r0y7t98du+qunl5s52davi0jh0qz6g+poatd7bhd9ehf3ukmu0j&wt=xml:java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=cat:stz3btky9qhc9ukvfqvb+cwgra9szrrtw60kiqy4a+pxxjcybysv0r0y7t98du+qunl5s52davi0jh0qz6g+poatd7bhd9ehf3ukmu0j&wt=xml
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
   [junit4]   2> 	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
   [junit4]   2> 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 532610 INFO  (TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[178282F9A056ADDD]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMultipleThreads
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=AtomicUpdateProcessorFactoryTest -Dtests.method=testMultipleThreads -Dtests.seed=178282F9A056ADDD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=en-SL -Dtests.timezone=Asia/Chungking -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.03s J2 | AtomicUpdateProcessorFactoryTest.testMultipleThreads <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([178282F9A056ADDD:3BB0F5742C92DB59]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
   [junit4]    > 	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]    > </response>
   [junit4]    > 	request was:q=cat:stz3btky9qhc9ukvfqvb+cwgra9szrrtw60kiqy4a+pxxjcybysv0r0y7t98du+qunl5s52davi0jh0qz6g+poatd7bhd9ehf3ukmu0j&wt=xml
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
   [junit4]    > 	... 39 more
   [junit4]   2> 532611 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 532611 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=865413027
   [junit4]   2> 532611 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 532611 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@77023948: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@620b6d15
   [junit4]   2> 532613 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 532613 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@61bdfdea: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@787d4835
   [junit4]   2> 532615 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 532615 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4d2adbd2: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2911e5e0
   [junit4]   2> 532616 INFO  (coreCloseExecutor-1753-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@29f5535c
   [junit4]   2> 532616 INFO  (coreCloseExecutor-1753-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=703943516
   [junit4]   2> 532616 INFO  (coreCloseExecutor-1753-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@40ae96c4: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@5b1b4269
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_178282F9A056ADDD-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {name_s=BlockTreeOrds(blocksize=128), title_stringNoNorms=PostingsFormat(name=LuceneFixedGap), title_stemmed=PostingsFormat(name=LuceneVarGapDocFreqInterval), multiDefault=PostingsFormat(name=LuceneFixedGap), cat=PostingsFormat(name=LuceneFixedGap), id=BlockTreeOrds(blocksize=128), text=FST50, title=PostingsFormat(name=LuceneVarGapDocFreqInterval), title_lettertok=BlockTreeOrds(blocksize=128)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), _version_=DocValuesFormat(name=Lucene70), range_facet_i_dv=DocValuesFormat(name=Memory), intDvoDefault=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1416, maxMBSortInHeap=5.966011131754559, sim=RandomSimilarity(queryNorm=true): {}, locale=en-SL, timezone=Asia/Chungking
   [junit4]   2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=347969704,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestCloudSearcherWarming, TestIntervalFaceting, TestFilteredDocIdSet, TestDeleteCollectionOnDownNodes, TestSolrCloudWithKerberosAlt, ResponseLogComponentTest, TestBadConfig, ConcurrentCreateRoutedAliasTest, DateRangeFieldTest, AddReplicaTest, WrapperMergePolicyFactoryTest, TestShardHandlerFactory, TestOverriddenPrefixQueryForCustomFieldType, TestCloudPivotFacet, TestSolrXml, RollingRestartTest, HttpTriggerListenerTest, TestRandomRequestDistribution, TestCollectionAPI, SolrXmlInZkTest, DateMathParserTest, LIRRollingUpdatesTest, IndexSchemaRuntimeFieldTest, BasicDistributedZk2Test, TestDistributedMissingSort, TestFaceting, SolrTestCaseJ4Test, DocValuesMultiTest, SearchRateTriggerTest, SecurityConfHandlerTest, TestCorePropertiesReload, CoreAdminHandlerTest, TestValueSourceCache, TestExpandComponent, FileBasedSpellCheckerTest, HdfsTlogReplayBufferedWhileIndexingTest, TestHdfsUpdateLog, TestInitQParser, StatelessScriptUpdateProcessorFactoryTest, MetricUtilsTest, TestInitParams, TestJsonRequest, TestSolrDeletionPolicy2, LeaderFailureAfterFreshStartTest, AtomicUpdateProcessorFactoryTest]
   [junit4] Completed [133/784 (1!)] on J2 in 0.47s, 4 tests, 1 error <<< FAILURES!

[...truncated 767 lines...]
   [junit4] Suite: org.apache.solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster
   [junit4]   2> 1286703 INFO  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_178282F9A056ADDD-001/init-core-data-001
   [junit4]   2> 1286704 WARN  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> 1286704 INFO  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1286704 INFO  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 1286708 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[178282F9A056ADDD]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_178282F9A056ADDD-001/tempDir-001
   [junit4]   2> 1286708 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[178282F9A056ADDD]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1286711 INFO  (Thread-2193) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1286711 INFO  (Thread-2193) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1286735 ERROR (Thread-2193) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1286811 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[178282F9A056ADDD]) [    ] o.a.s.c.ZkTestServer start zk server on port:36361
   [junit4]   2> 1286843 INFO  (zkConnectionManagerCallback-2551-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1286852 INFO  (jetty-launcher-2548-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ٢٠١٧-١١-٢٢T٠٨:٢٧:٣٧+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1286855 INFO  (jetty-launcher-2548-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ٢٠١٧-١١-٢٢T٠٨:٢٧:٣٧+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1286855 INFO  (jetty-launcher-2548-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ٢٠١٧-١١-٢٢T٠٨:٢٧:٣٧+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1286855 INFO  (jetty-launcher-2548-th

[...truncated too long message...]

ltiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=en-SL -Dtests.timezone=Asia/Chungking -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.02s J2 | AtomicUpdateProcessorFactoryTest.testMultipleThreads <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([178282F9A056ADDD:3BB0F5742C92DB59]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
   [junit4]    > 	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]    > </response>
   [junit4]    > 	request was:q=cat:stz3btky9qhc9ukvfqvb+cwgra9szrrtw60kiqy4a+pxxjcybysv0r0y7t98du+qunl5s52davi0jh0qz6g+poatd7bhd9ehf3ukmu0j&wt=xml
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
   [junit4]    > 	... 39 more
   [junit4]   2> 187055 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 187055 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1846513685
   [junit4]   2> 187055 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 187055 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@d9981f0: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2a2ca0c7
   [junit4]   2> 187057 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 187057 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@496694eb: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@547f7568
   [junit4]   2> 187059 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 187059 INFO  (SUITE-AtomicUpdateProcessorFactoryTest-seed#[178282F9A056ADDD]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5a9f1ab4: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@18517285
   [junit4]   2> 187059 INFO  (coreCloseExecutor-1003-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3a3a1c2c
   [junit4]   2> 187059 INFO  (coreCloseExecutor-1003-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=976886828
   [junit4]   2> 187059 INFO  (coreCloseExecutor-1003-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@78b3c87c: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@88c091f
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_178282F9A056ADDD-005
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {name_s=BlockTreeOrds(blocksize=128), title_stringNoNorms=PostingsFormat(name=LuceneFixedGap), title_stemmed=PostingsFormat(name=LuceneVarGapDocFreqInterval), multiDefault=PostingsFormat(name=LuceneFixedGap), cat=PostingsFormat(name=LuceneFixedGap), id=BlockTreeOrds(blocksize=128), text=FST50, title=PostingsFormat(name=LuceneVarGapDocFreqInterval), title_lettertok=BlockTreeOrds(blocksize=128)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), _version_=DocValuesFormat(name=Lucene70), range_facet_i_dv=DocValuesFormat(name=Memory), intDvoDefault=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1416, maxMBSortInHeap=5.966011131754559, sim=RandomSimilarity(queryNorm=true): {}, locale=en-SL, timezone=Asia/Chungking
   [junit4]   2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=277936400,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [AtomicUpdateProcessorFactoryTest, TestCollectionsAPIViaSolrCloudCluster, TestCollectionsAPIViaSolrCloudCluster, AtomicUpdateProcessorFactoryTest, AtomicUpdateProcessorFactoryTest, MoveReplicaHDFSTest, TestCollectionsAPIViaSolrCloudCluster, AtomicUpdateProcessorFactoryTest, AtomicUpdateProcessorFactoryTest]
   [junit4] Completed [13/15 (5!)] on J2 in 0.52s, 4 tests, 1 error <<< FAILURES!
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
   [junit4] OK      11.0s J0 | MoveReplicaHDFSTest.testFailedMove
   [junit4] OK      11.2s J0 | MoveReplicaHDFSTest.testNormalFailedMove
   [junit4] OK      21.6s J0 | MoveReplicaHDFSTest.test
   [junit4] OK      16.6s J0 | MoveReplicaHDFSTest.testNormalMove
   [junit4] Completed [14/15 (5!)] on J0 in 73.38s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
   [junit4] OK      14.3s J1 | MoveReplicaHDFSTest.testFailedMove
   [junit4] OK      11.8s J1 | MoveReplicaHDFSTest.testNormalFailedMove
   [junit4] OK      23.6s J1 | MoveReplicaHDFSTest.test
   [junit4] OK      19.2s J1 | MoveReplicaHDFSTest.testNormalMove
   [junit4] Completed [15/15 (5!)] on J1 in 82.58s, 4 tests
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 178282F9A056ADDD]:
   [junit4]   - org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads
   [junit4]   - org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads
   [junit4]   - org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads
   [junit4]   - org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads
   [junit4]   - org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.94 ..   201.07 =   200.13s
   [junit4] JVM J1:     0.92 ..   201.09 =   200.17s
   [junit4] JVM J2:     0.91 ..   189.87 =   188.96s
   [junit4] Execution time total: 3 minutes 21 seconds
   [junit4] Tests summary: 15 suites, 55 tests, 5 errors

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 15 suites, 55 tests, 5 errors [seed: 178282F9A056ADDD]

Total time: 3 minutes 22 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.MoveReplicaHDFSTest
[repro]   0/5 failed: org.apache.solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster
[repro]   5/5 failed: org.apache.solr.ltr.TestLTRReRankingPipeline
[repro]   5/5 failed: org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=11af2144b66717f41e2fcb5c73c7059cf009a00a, workspace=/var/lib/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #10
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-BadApples-7.x-Linux (64bit/jdk-9.0.4) - Build # 10 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/10/
Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseParallelGC

13 tests failed.
FAILED:  org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
Error from server at https://127.0.0.1:33575/solr/awhollynewcollection_0: No registered leader was found after waiting for 4000ms , collection: awhollynewcollection_0 slice: shard2 saw state=DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/8)={   "pullReplicas":"0",   "replicationFactor":"4",   "shards":{     "shard1":{       "range":"80000000-b332ffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"awhollynewcollection_0_shard1_replica_n1",           "base_url":"https://127.0.0.1:33575/solr",           "node_name":"127.0.0.1:33575_solr",           "state":"active",           "type":"NRT"},         "core_node5":{           "core":"awhollynewcollection_0_shard1_replica_n2",           "base_url":"https://127.0.0.1:42155/solr",           "node_name":"127.0.0.1:42155_solr",           "state":"active",           "type":"NRT"},         "core_node7":{           "core":"awhollynewcollection_0_shard1_replica_n4",           "base_url":"https://127.0.0.1:45069/solr",           "node_name":"127.0.0.1:45069_solr",           "state":"down",           "type":"NRT"},         "core_node9":{           "core":"awhollynewcollection_0_shard1_replica_n6",           "base_url":"https://127.0.0.1:33197/solr",           "node_name":"127.0.0.1:33197_solr",           "state":"active",           "type":"NRT"}}},     "shard2":{       "range":"b3330000-e665ffff",       "state":"active",       "replicas":{         "core_node11":{           "core":"awhollynewcollection_0_shard2_replica_n8",           "base_url":"https://127.0.0.1:33575/solr",           "node_name":"127.0.0.1:33575_solr",           "state":"active",           "type":"NRT"},         "core_node13":{           "core":"awhollynewcollection_0_shard2_replica_n10",           "base_url":"https://127.0.0.1:42155/solr",           "node_name":"127.0.0.1:42155_solr",           "state":"active",           "type":"NRT"},         "core_node15":{           "core":"awhollynewcollection_0_shard2_replica_n12",           "base_url":"https://127.0.0.1:45069/solr",           "node_name":"127.0.0.1:45069_solr",           "state":"down",           "type":"NRT"},         "core_node17":{           "core":"awhollynewcollection_0_shard2_replica_n14",           "base_url":"https://127.0.0.1:33197/solr",           "node_name":"127.0.0.1:33197_solr",           "state":"active",           "type":"NRT"}}},     "shard3":{       "range":"e6660000-1998ffff",       "state":"active",       "replicas":{         "core_node19":{           "core":"awhollynewcollection_0_shard3_replica_n16",           "base_url":"https://127.0.0.1:33575/solr",           "node_name":"127.0.0.1:33575_solr",           "state":"active",           "type":"NRT",           "leader":"true"},         "core_node21":{           "core":"awhollynewcollection_0_shard3_replica_n18",           "base_url":"https://127.0.0.1:42155/solr",           "node_name":"127.0.0.1:42155_solr",           "state":"active",           "type":"NRT"},         "core_node23":{           "core":"awhollynewcollection_0_shard3_replica_n20",           "base_url":"https://127.0.0.1:45069/solr",           "node_name":"127.0.0.1:45069_solr",           "state":"down",           "type":"NRT"},         "core_node25":{           "core":"awhollynewcollection_0_shard3_replica_n22",           "base_url":"https://127.0.0.1:33197/solr",           "node_name":"127.0.0.1:33197_solr",           "state":"active",           "type":"NRT"}}},     "shard4":{       "range":"19990000-4ccbffff",       "state":"active",       "replicas":{         "core_node27":{           "core":"awhollynewcollection_0_shard4_replica_n24",           "base_url":"https://127.0.0.1:33575/solr",           "node_name":"127.0.0.1:33575_solr",           "state":"active",           "type":"NRT",           "leader":"true"},         "core_node29":{           "core":"awhollynewcollection_0_shard4_replica_n26",           "base_url":"https://127.0.0.1:42155/solr",           "node_name":"127.0.0.1:42155_solr",           "state":"active",           "type":"NRT"},         "core_node31":{           "core":"awhollynewcollection_0_shard4_replica_n28",           "base_url":"https://127.0.0.1:45069/solr",           "node_name":"127.0.0.1:45069_solr",           "state":"down",           "type":"NRT"},         "core_node33":{           "core":"awhollynewcollection_0_shard4_replica_n30",           "base_url":"https://127.0.0.1:33197/solr",           "node_name":"127.0.0.1:33197_solr",           "state":"active",           "type":"NRT"}}},     "shard5":{       "range":"4ccc0000-7fffffff",       "state":"active",       "replicas":{         "core_node35":{           "core":"awhollynewcollection_0_shard5_replica_n32",           "base_url":"https://127.0.0.1:33575/solr",           "node_name":"127.0.0.1:33575_solr",           "state":"active",           "type":"NRT"},         "core_node37":{           "core":"awhollynewcollection_0_shard5_replica_n34",           "base_url":"https://127.0.0.1:42155/solr",           "node_name":"127.0.0.1:42155_solr",           "state":"active",           "type":"NRT"},         "core_node39":{           "core":"awhollynewcollection_0_shard5_replica_n36",           "base_url":"https://127.0.0.1:45069/solr",           "node_name":"127.0.0.1:45069_solr",           "state":"down",           "type":"NRT"},         "core_node40":{           "core":"awhollynewcollection_0_shard5_replica_n38",           "base_url":"https://127.0.0.1:33197/solr",           "node_name":"127.0.0.1:33197_solr",           "state":"active",           "type":"NRT"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"6",   "autoAddReplicas":"false",   "nrtReplicas":"4",   "tlogReplicas":"0"} with live_nodes=[127.0.0.1:33575_solr, 127.0.0.1:33197_solr, 127.0.0.1:42155_solr, 127.0.0.1:45069_solr]

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:33575/solr/awhollynewcollection_0: No registered leader was found after waiting for 4000ms , collection: awhollynewcollection_0 slice: shard2 saw state=DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/8)={
  "pullReplicas":"0",
  "replicationFactor":"4",
  "shards":{
    "shard1":{
      "range":"80000000-b332ffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"awhollynewcollection_0_shard1_replica_n1",
          "base_url":"https://127.0.0.1:33575/solr",
          "node_name":"127.0.0.1:33575_solr",
          "state":"active",
          "type":"NRT"},
        "core_node5":{
          "core":"awhollynewcollection_0_shard1_replica_n2",
          "base_url":"https://127.0.0.1:42155/solr",
          "node_name":"127.0.0.1:42155_solr",
          "state":"active",
          "type":"NRT"},
        "core_node7":{
          "core":"awhollynewcollection_0_shard1_replica_n4",
          "base_url":"https://127.0.0.1:45069/solr",
          "node_name":"127.0.0.1:45069_solr",
          "state":"down",
          "type":"NRT"},
        "core_node9":{
          "core":"awhollynewcollection_0_shard1_replica_n6",
          "base_url":"https://127.0.0.1:33197/solr",
          "node_name":"127.0.0.1:33197_solr",
          "state":"active",
          "type":"NRT"}}},
    "shard2":{
      "range":"b3330000-e665ffff",
      "state":"active",
      "replicas":{
        "core_node11":{
          "core":"awhollynewcollection_0_shard2_replica_n8",
          "base_url":"https://127.0.0.1:33575/solr",
          "node_name":"127.0.0.1:33575_solr",
          "state":"active",
          "type":"NRT"},
        "core_node13":{
          "core":"awhollynewcollection_0_shard2_replica_n10",
          "base_url":"https://127.0.0.1:42155/solr",
          "node_name":"127.0.0.1:42155_solr",
          "state":"active",
          "type":"NRT"},
        "core_node15":{
          "core":"awhollynewcollection_0_shard2_replica_n12",
          "base_url":"https://127.0.0.1:45069/solr",
          "node_name":"127.0.0.1:45069_solr",
          "state":"down",
          "type":"NRT"},
        "core_node17":{
          "core":"awhollynewcollection_0_shard2_replica_n14",
          "base_url":"https://127.0.0.1:33197/solr",
          "node_name":"127.0.0.1:33197_solr",
          "state":"active",
          "type":"NRT"}}},
    "shard3":{
      "range":"e6660000-1998ffff",
      "state":"active",
      "replicas":{
        "core_node19":{
          "core":"awhollynewcollection_0_shard3_replica_n16",
          "base_url":"https://127.0.0.1:33575/solr",
          "node_name":"127.0.0.1:33575_solr",
          "state":"active",
          "type":"NRT",
          "leader":"true"},
        "core_node21":{
          "core":"awhollynewcollection_0_shard3_replica_n18",
          "base_url":"https://127.0.0.1:42155/solr",
          "node_name":"127.0.0.1:42155_solr",
          "state":"active",
          "type":"NRT"},
        "core_node23":{
          "core":"awhollynewcollection_0_shard3_replica_n20",
          "base_url":"https://127.0.0.1:45069/solr",
          "node_name":"127.0.0.1:45069_solr",
          "state":"down",
          "type":"NRT"},
        "core_node25":{
          "core":"awhollynewcollection_0_shard3_replica_n22",
          "base_url":"https://127.0.0.1:33197/solr",
          "node_name":"127.0.0.1:33197_solr",
          "state":"active",
          "type":"NRT"}}},
    "shard4":{
      "range":"19990000-4ccbffff",
      "state":"active",
      "replicas":{
        "core_node27":{
          "core":"awhollynewcollection_0_shard4_replica_n24",
          "base_url":"https://127.0.0.1:33575/solr",
          "node_name":"127.0.0.1:33575_solr",
          "state":"active",
          "type":"NRT",
          "leader":"true"},
        "core_node29":{
          "core":"awhollynewcollection_0_shard4_replica_n26",
          "base_url":"https://127.0.0.1:42155/solr",
          "node_name":"127.0.0.1:42155_solr",
          "state":"active",
          "type":"NRT"},
        "core_node31":{
          "core":"awhollynewcollection_0_shard4_replica_n28",
          "base_url":"https://127.0.0.1:45069/solr",
          "node_name":"127.0.0.1:45069_solr",
          "state":"down",
          "type":"NRT"},
        "core_node33":{
          "core":"awhollynewcollection_0_shard4_replica_n30",
          "base_url":"https://127.0.0.1:33197/solr",
          "node_name":"127.0.0.1:33197_solr",
          "state":"active",
          "type":"NRT"}}},
    "shard5":{
      "range":"4ccc0000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node35":{
          "core":"awhollynewcollection_0_shard5_replica_n32",
          "base_url":"https://127.0.0.1:33575/solr",
          "node_name":"127.0.0.1:33575_solr",
          "state":"active",
          "type":"NRT"},
        "core_node37":{
          "core":"awhollynewcollection_0_shard5_replica_n34",
          "base_url":"https://127.0.0.1:42155/solr",
          "node_name":"127.0.0.1:42155_solr",
          "state":"active",
          "type":"NRT"},
        "core_node39":{
          "core":"awhollynewcollection_0_shard5_replica_n36",
          "base_url":"https://127.0.0.1:45069/solr",
          "node_name":"127.0.0.1:45069_solr",
          "state":"down",
          "type":"NRT"},
        "core_node40":{
          "core":"awhollynewcollection_0_shard5_replica_n38",
          "base_url":"https://127.0.0.1:33197/solr",
          "node_name":"127.0.0.1:33197_solr",
          "state":"active",
          "type":"NRT"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"6",
  "autoAddReplicas":"false",
  "nrtReplicas":"4",
  "tlogReplicas":"0"} with live_nodes=[127.0.0.1:33575_solr, 127.0.0.1:33197_solr, 127.0.0.1:42155_solr, 127.0.0.1:45069_solr]
	at __randomizedtesting.SeedInfo.seed([3598279036583C8F:7DED5324306B131A]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1105)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:885)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:818)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
	at org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:464)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeLostTrigger

Error Message:
Error from server at https://127.0.0.1:36123/solr: delete the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:36123/solr: delete the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([3598279036583C8F:31668E820C92BE15]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1105)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:885)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:818)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.setupTest(TriggerIntegrationTest.java:170)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger

Error Message:
Error from server at https://127.0.0.1:36123/solr: delete the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:36123/solr: delete the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([3598279036583C8F:8F94101F69B0EAC0]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1105)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:885)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:818)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.setupTest(TriggerIntegrationTest.java:170)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeAddedTrigger

Error Message:
Error from server at https://127.0.0.1:36123/solr: delete the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:36123/solr: delete the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([3598279036583C8F:13F299A92D5793E3]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1105)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:885)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:818)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.setupTest(TriggerIntegrationTest.java:170)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeLostTriggerRestoreState

Error Message:
Error from server at https://127.0.0.1:36123/solr: Could not find collection : collection1

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:36123/solr: Could not find collection : collection1
	at __randomizedtesting.SeedInfo.seed([3598279036583C8F:1E67F2CBAC20295F]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1105)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:885)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:818)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.setupTest(TriggerIntegrationTest.java:170)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster:     1) Thread[id=681, name=AutoscalingActionExecutor-16-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at java.base@9.0.4/java.util.TimSort.countRunAndMakeAscending(TimSort.java:360)         at java.base@9.0.4/java.util.TimSort.sort(TimSort.java:234)         at java.base@9.0.4/java.util.Arrays.sort(Arrays.java:1514)         at java.base@9.0.4/java.util.ArrayList.sort(ArrayList.java:1587)         at java.base@9.0.4/java.util.Collections.sort(Collections.java:175)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy.setApproxValuesAndSortNodes(Policy.java:374)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.applyRules(Policy.java:312)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:64)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$204/1029368681.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$148/1071909801.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster: 
   1) Thread[id=681, name=AutoscalingActionExecutor-16-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at java.base@9.0.4/java.util.TimSort.countRunAndMakeAscending(TimSort.java:360)
        at java.base@9.0.4/java.util.TimSort.sort(TimSort.java:234)
        at java.base@9.0.4/java.util.Arrays.sort(Arrays.java:1514)
        at java.base@9.0.4/java.util.ArrayList.sort(ArrayList.java:1587)
        at java.base@9.0.4/java.util.Collections.sort(Collections.java:175)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy.setApproxValuesAndSortNodes(Policy.java:374)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.applyRules(Policy.java:312)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:64)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$204/1029368681.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$148/1071909801.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([3598279036583C8F]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=681, name=AutoscalingActionExecutor-16-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:90)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$222/1184248814.apply(Unknown Source)         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.removeReplica(Row.java:156)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:60)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$204/1029368681.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$148/1071909801.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=681, name=AutoscalingActionExecutor-16-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:90)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$222/1184248814.apply(Unknown Source)
        at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
        at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
        at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.removeReplica(Row.java:156)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:60)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$204/1029368681.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$148/1071909801.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([3598279036583C8F]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster:     1) Thread[id=30994, name=AutoscalingActionExecutor-11588-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:131)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:110)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$726/880468369.apply(Unknown Source)         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$618/1210336001.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$228/1182066331.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster: 
   1) Thread[id=30994, name=AutoscalingActionExecutor-11588-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:131)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:110)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$726/880468369.apply(Unknown Source)
        at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
        at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
        at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$618/1210336001.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$228/1182066331.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([3598279036583C8F]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=30994, name=AutoscalingActionExecutor-11588-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:90)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$726/880468369.apply(Unknown Source)         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.removeReplica(Row.java:156)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:60)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$618/1210336001.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$228/1182066331.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=30994, name=AutoscalingActionExecutor-11588-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:90)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$726/880468369.apply(Unknown Source)
        at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
        at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
        at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.removeReplica(Row.java:156)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:60)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$618/1210336001.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$228/1182066331.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([3598279036583C8F]:0)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([A9B7C927CE2B494:FB3A0EC249597E06]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([A9B7C927CE2B494:FB3A0EC249597E06]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([A9B7C927CE2B494:FB3A0EC249597E06]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([A9B7C927CE2B494:FB3A0EC249597E06]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1780 lines...]
   [junit4] JVM J1: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/core/test/temp/junit4-J1-20180318_060741_42616229905752201553649.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] codec: FastCompressingStoredFields, pf: MockRandom, dvf: Asserting
   [junit4] <<< JVM J1: EOF ----

[...truncated 11143 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> 254212 INFO  (SUITE-TriggerIntegrationTest-seed#[3598279036583C8F]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_3598279036583C8F-001/init-core-data-001
   [junit4]   2> 254213 INFO  (SUITE-TriggerIntegrationTest-seed#[3598279036583C8F]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 254214 INFO  (SUITE-TriggerIntegrationTest-seed#[3598279036583C8F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 254215 INFO  (SUITE-TriggerIntegrationTest-seed#[3598279036583C8F]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_3598279036583C8F-001/tempDir-001
   [junit4]   2> 254215 INFO  (SUITE-TriggerIntegrationTest-seed#[3598279036583C8F]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 254227 INFO  (Thread-900) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 254227 INFO  (Thread-900) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 254236 ERROR (Thread-900) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 254327 INFO  (SUITE-TriggerIntegrationTest-seed#[3598279036583C8F]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:39059
   [junit4]   2> 254349 INFO  (zkConnectionManagerCallback-1144-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 254355 INFO  (jetty-launcher-1141-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 254361 INFO  (jetty-launcher-1141-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 254362 INFO  (jetty-launcher-1141-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 254362 INFO  (jetty-launcher-1141-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 254362 INFO  (jetty-launcher-1141-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 254362 INFO  (jetty-launcher-1141-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@56319626{/solr,null,AVAILABLE}
   [junit4]   2> 254364 INFO  (jetty-launcher-1141-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@463e60c3{SSL,[ssl, http/1.1]}{127.0.0.1:37943}
   [junit4]   2> 254364 INFO  (jetty-launcher-1141-thread-1) [    ] o.e.j.s.Server Started @255909ms
   [junit4]   2> 254364 INFO  (jetty-launcher-1141-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37943}
   [junit4]   2> 254364 ERROR (jetty-launcher-1141-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 254364 INFO  (jetty-launcher-1141-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.4.0
   [junit4]   2> 254364 INFO  (jetty-launcher-1141-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 254364 INFO  (jetty-launcher-1141-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 254365 INFO  (jetty-launcher-1141-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-18T06:34:42.234007Z
   [junit4]   2> 254366 INFO  (jetty-launcher-1141-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 254366 INFO  (jetty-launcher-1141-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 254366 INFO  (jetty-launcher-1141-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 254367 INFO  (jetty-launcher-1141-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b62c4b1{/solr,null,AVAILABLE}
   [junit4]   2> 254368 INFO  (jetty-launcher-1141-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@296dac78{SSL,[ssl, http/1.1]}{127.0.0.1:40949}
   [junit4]   2> 254368 INFO  (jetty-launcher-1141-thread-2) [    ] o.e.j.s.Server Started @255914ms
   [junit4]   2> 254368 INFO  (jetty-launcher-1141-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40949}
   [junit4]   2> 254368 ERROR (jetty-launcher-1141-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 254368 INFO  (jetty-launcher-1141-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.4.0
   [junit4]   2> 254368 INFO  (jetty-launcher-1141-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 254368 INFO  (jetty-launcher-1141-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 254368 INFO  (jetty-launcher-1141-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-18T06:34:42.237963Z
   [junit4]   2> 254371 INFO  (zkConnectionManagerCallback-1146-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 254371 INFO  (jetty-launcher-1141-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 254375 INFO  (zkConnectionManagerCallback-1148-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 254376 INFO  (jetty-launcher-1141-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 254389 INFO  (jetty-launcher-1141-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39059/solr
   [junit4]   2> 254399 INFO  (jetty-launcher-1141-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39059/solr
   [junit4]   2> 254407 INFO  (zkConnectionManagerCallback-1152-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 254414 INFO  (zkConnectionManagerCallback-1156-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 254417 INFO  (zkConnectionManagerCallback-1158-thread-1-processing-n:127.0.0.1:37943_solr) [n:127.0.0.1:37943_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 254428 INFO  (zkConnectionManagerCallback-1160-thread-1-processing-n:127.0.0.1:40949_solr) [n:127.0.0.1:40949_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 254437 INFO  (jetty-launcher-1141-thread-2) [n:127.0.0.1:40949_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 254437 INFO  (jetty-launcher-1141-thread-2) [n:127.0.0.1:40949_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40949_solr
   [junit4]   2> 254438 INFO  (jetty-launcher-1141-thread-2) [n:127.0.0.1:40949_solr    ] o.a.s.c.Overseer Overseer (id=72155405810008070-127.0.0.1:40949_solr-n_0000000000) starting
   [junit4]   2> 254480 INFO  (zkConnectionManagerCallback-1166-thread-1-processing-n:127.0.0.1:40949_solr) [n:127.0.0.1:40949_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 254481 INFO  (jetty-launcher-1141-thread-2) [n:127.0.0.1:40949_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39059/solr ready
   [junit4]   2> 254484 INFO  (jetty-launcher-1141-thread-1) [n:127.0.0.1:37943_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 254484 INFO  (jetty-launcher-1141-thread-1) [n:127.0.0.1:37943_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37943_solr
   [junit4]   2> 254488 INFO  (OverseerStateUpdate-72155405810008070-127.0.0.1:40949_solr-n_0000000000) [n:127.0.0.1:40949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 254488 INFO  (jetty-launcher-1141-thread-2) [n:127.0.0.1:40949_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40949_solr
   [junit4]   2> 254496 DEBUG (OverseerAutoScalingTriggerThread-72155405810008070-127.0.0.1:40949_solr-n_0000000000) [n:127.0.0.1:40949_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 254504 DEBUG (OverseerAutoScalingTriggerThread-72155405810008070-127.0.0.1:40949_solr-n_0000000000) [n:127.0.0.1:40949_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 254505 INFO  (zkCallback-1159-thread-1-processing-n:127.0.0.1:40949_solr) [n:127.0.0.1:40949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 254516 INFO  (zkCallback-1157-thread-1-processing-n:127.0.0.1:37943_solr) [n:127.0.0.1:37943_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 254519 DEBUG (OverseerAutoScalingTriggerThread-72155405810008070-127.0.0.1:40949_solr-n_0000000000) [n:127.0.0.1:40949_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: []
   [junit4]   2> 254519 DEBUG (OverseerAutoScalingTriggerThread-72155405810008070-127.0.0.1:40949_solr-n_0000000000) [n:127.0.0.1:40949_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 254519 DEBUG (OverseerAutoScalingTriggerThread-72155405810008070-127.0.0.1:40949_solr-n_0000000000) [n:127.0.0.1:40949_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 254520 INFO  (zkCallback-1165-thread-1-processing-n:127.0.0.1:40949_solr) [n:127.0.0.1:40949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 254546 DEBUG (OverseerAutoScalingTriggerThread-72155405810008070-127.0.0.1:40949_solr-n_0000000000) [n:127.0.0.1:40949_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 254547 DEBUG (OverseerAutoScalingTriggerThread-72155405810008070-127.0.0.1:40949_solr-n_0000000000) [n:127.0.0.1:40949_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 254547 DEBUG (ScheduledTrigger-1264-thread-2) [n:127.0.0.1:40949_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 254577 INFO  (jetty-launcher-1141-thread-2) [n:127.0.0.1:40949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40949.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@30c48266
   [junit4] 

[...truncated too long message...]

aling.Policy$Session.getMatrixCopy(Policy.java:300)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.removeReplica(Row.java:156)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:60)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
   [junit4]    >         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
   [junit4]    >         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
   [junit4]    >         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$204/1029368681.run(Unknown Source)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]    >         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]    >         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$148/1071909801.run(Unknown Source)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    >         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3598279036583C8F]:0)
   [junit4] Completed [1/15 (1!)] on J2 in 62.01s, 4 tests, 2 errors <<< FAILURES!
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest
   [junit4] Completed [2/15 (1!)] on J2 in 0.01s, 19 tests, 19 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4] Completed [3/15 (1!)] on J2 in 0.01s, 15 tests, 15 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster
   [junit4] Completed [4/15 (1!)] on J2 in 0.00s, 4 tests, 4 skipped
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest
   [junit4] Completed [5/15 (1!)] on J2 in 0.00s, 19 tests, 19 skipped
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest
   [junit4] Completed [6/15 (1!)] on J2 in 0.00s, 19 tests, 19 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4] Completed [7/15 (1!)] on J2 in 0.00s, 15 tests, 15 skipped
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4] Completed [8/15 (1!)] on J2 in 0.00s, 15 tests, 15 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest
   [junit4] Completed [9/15 (1!)] on J2 in 0.00s, 19 tests, 19 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest
   [junit4] Completed [10/15 (1!)] on J2 in 0.00s, 19 tests, 19 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster
   [junit4] Completed [11/15 (1!)] on J2 in 0.00s, 4 tests, 4 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster
   [junit4] Completed [12/15 (1!)] on J2 in 0.01s, 4 tests, 4 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster
   [junit4] Completed [13/15 (1!)] on J2 in 0.00s, 4 tests, 4 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4] OK      29.6s J0 | TriggerIntegrationTest.testCooldown
   [junit4] OK      16.9s J0 | TriggerIntegrationTest.testNodeMarkersRegistration
   [junit4] OK      17.3s J0 | TriggerIntegrationTest.testTriggerThrottling
   [junit4] OK      18.3s J0 | TriggerIntegrationTest.testContinueTriggersOnOverseerRestart
   [junit4] OK      31.5s J0 | TriggerIntegrationTest.testEventFromRestoredState
   [junit4] OK      7.02s J0 | TriggerIntegrationTest.testNodeAddedTriggerRestoreState
   [junit4] OK      30.2s J0 | TriggerIntegrationTest.testSetProperties
   [junit4] OK      17.2s J0 | TriggerIntegrationTest.testListeners
   [junit4] OK      13.8s J0 | TriggerIntegrationTest.testEventQueue
   [junit4] OK      18.1s J0 | TriggerIntegrationTest.testScheduledTrigger
   [junit4] OK      33.2s J0 | TriggerIntegrationTest.testSearchRate
   [junit4] OK      11.1s J0 | TriggerIntegrationTest.testNodeLostTrigger
   [junit4] OK      35.2s J0 | TriggerIntegrationTest.testMetricTrigger
   [junit4] OK      14.5s J0 | TriggerIntegrationTest.testNodeAddedTrigger
   [junit4] OK      6.99s J0 | TriggerIntegrationTest.testNodeLostTriggerRestoreState
   [junit4] Completed [14/15 (1!)] on J0 in 308.15s, 15 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4] OK      29.7s J1 | TriggerIntegrationTest.testCooldown
   [junit4] OK      17.0s J1 | TriggerIntegrationTest.testNodeMarkersRegistration
   [junit4] OK      17.2s J1 | TriggerIntegrationTest.testTriggerThrottling
   [junit4] OK      18.3s J1 | TriggerIntegrationTest.testContinueTriggersOnOverseerRestart
   [junit4] OK      31.4s J1 | TriggerIntegrationTest.testEventFromRestoredState
   [junit4] OK      7.06s J1 | TriggerIntegrationTest.testNodeAddedTriggerRestoreState
   [junit4] OK      34.3s J1 | TriggerIntegrationTest.testSetProperties
   [junit4] OK      17.3s J1 | TriggerIntegrationTest.testListeners
   [junit4] OK      12.3s J1 | TriggerIntegrationTest.testEventQueue
   [junit4] OK      18.2s J1 | TriggerIntegrationTest.testScheduledTrigger
   [junit4] OK      33.2s J1 | TriggerIntegrationTest.testSearchRate
   [junit4] OK      13.9s J1 | TriggerIntegrationTest.testNodeLostTrigger
   [junit4] OK      35.1s J1 | TriggerIntegrationTest.testMetricTrigger
   [junit4] OK      14.5s J1 | TriggerIntegrationTest.testNodeAddedTrigger
   [junit4] OK      7.01s J1 | TriggerIntegrationTest.testNodeLostTriggerRestoreState
   [junit4] Completed [15/15 (1!)] on J1 in 315.52s, 15 tests
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 3598279036583C8F]:
   [junit4]   - org.apache.solr.cloud.autoscaling.sim.TestLargeCluster (suite)
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.94 ..   310.06 =   309.12s
   [junit4] JVM J1:     0.95 ..   317.30 =   316.36s
   [junit4] JVM J2:     0.94 ..    65.71 =    64.76s
   [junit4] Execution time total: 5 minutes 17 seconds
   [junit4] Tests summary: 15 suites, 190 tests, 2 suite-level errors, 156 ignored

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 15 suites, 190 tests, 2 suite-level errors, 156 ignored [seed: 3598279036583C8F]

Total time: 5 minutes 19 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[repro]   1/5 failed: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster
[repro]   5/5 failed: org.apache.solr.ltr.TestLTRReRankingPipeline
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=741b0685f0399afb2cf1b64950536f1ff2a46dfb, workspace=/var/lib/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #9
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-BadApples-7.x-Linux (64bit/jdk-9.0.4) - Build # 9 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/9/
Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseParallelGC

12 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster:     1) Thread[id=477, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:131)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:110)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$231/1388132079.apply(Unknown Source)         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$213/355972816.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$133/546346621.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster: 
   1) Thread[id=477, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:131)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:110)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$231/1388132079.apply(Unknown Source)
        at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
        at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
        at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$213/355972816.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$133/546346621.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([36FEC56D4E51CB32]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=477, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row$$Lambda$240/1365232703.accept(Unknown Source)         at java.base@9.0.4/java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.lambda$forEachReplica$5(Row.java:188)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row$$Lambda$239/707571610.accept(Unknown Source)         at java.base@9.0.4/java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.forEachReplica(Row.java:187)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.forEachReplica(Row.java:183)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggestion$ConditionType$1.projectAddReplica(Suggestion.java:185)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:131)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$213/355972816.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$133/546346621.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=477, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row$$Lambda$240/1365232703.accept(Unknown Source)
        at java.base@9.0.4/java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.lambda$forEachReplica$5(Row.java:188)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row$$Lambda$239/707571610.accept(Unknown Source)
        at java.base@9.0.4/java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.forEachReplica(Row.java:187)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.forEachReplica(Row.java:183)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggestion$ConditionType$1.projectAddReplica(Suggestion.java:185)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:131)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$213/355972816.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$133/546346621.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([36FEC56D4E51CB32]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster:     1) Thread[id=475, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at java.base@9.0.4/java.util.HashMap.putVal(HashMap.java:629)         at java.base@9.0.4/java.util.HashMap.put(HashMap.java:612)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$224/774717085.apply(Unknown Source)         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$206/14538823.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$140/1726300375.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster: 
   1) Thread[id=475, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at java.base@9.0.4/java.util.HashMap.putVal(HashMap.java:629)
        at java.base@9.0.4/java.util.HashMap.put(HashMap.java:612)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$224/774717085.apply(Unknown Source)
        at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
        at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
        at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$206/14538823.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$140/1726300375.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([36FEC56D4E51CB32]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=475, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:90)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$224/774717085.apply(Unknown Source)         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$206/14538823.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$140/1726300375.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=475, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:90)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$224/774717085.apply(Unknown Source)
        at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
        at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
        at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$206/14538823.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$140/1726300375.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([36FEC56D4E51CB32]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster:     1) Thread[id=475, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:131)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:110)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$221/956632256.apply(Unknown Source)         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$203/337266143.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$141/975764454.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster: 
   1) Thread[id=475, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:131)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:110)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$221/956632256.apply(Unknown Source)
        at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
        at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
        at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$203/337266143.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$141/975764454.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([36FEC56D4E51CB32]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=475, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:131)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:110)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$221/956632256.apply(Unknown Source)         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.removeReplica(Row.java:156)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:60)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$203/337266143.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$141/975764454.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=475, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:131)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:110)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$221/956632256.apply(Unknown Source)
        at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
        at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
        at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.removeReplica(Row.java:156)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:60)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$203/337266143.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$141/975764454.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([36FEC56D4E51CB32]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster:     1) Thread[id=35624, name=AutoscalingActionExecutor-8718-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:131)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:110)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$873/1097494223.apply(Unknown Source)         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$861/812944073.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$235/878986583.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster: 
   1) Thread[id=35624, name=AutoscalingActionExecutor-8718-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:131)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:110)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$873/1097494223.apply(Unknown Source)
        at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
        at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
        at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$861/812944073.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$235/878986583.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([36FEC56D4E51CB32]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=35624, name=AutoscalingActionExecutor-8718-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:90)         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$873/1097494223.apply(Unknown Source)         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$861/812944073.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$235/878986583.run(Unknown Source)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=35624, name=AutoscalingActionExecutor-8718-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:90)
        at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
        at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$873/1097494223.apply(Unknown Source)
        at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
        at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
        at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
        at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
        at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$861/812944073.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$235/878986583.run(Unknown Source)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([36FEC56D4E51CB32]:0)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([C491F709701F67CA:3530855945A4AD58]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([C491F709701F67CA:3530855945A4AD58]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([C491F709701F67CA:3530855945A4AD58]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([C491F709701F67CA:3530855945A4AD58]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1776 lines...]
   [junit4] JVM J2: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/build/core/test/temp/junit4-J2-20180316_042119_81610760182599948803291.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] codec: HighCompressionCompressingStoredFields, pf: MockRandom, dvf: Asserting
   [junit4] <<< JVM J2: EOF ----

[...truncated 12294 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster
   [junit4]   2> 2130935 INFO  (SUITE-TestLargeCluster-seed#[36FEC56D4E51CB32]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestLargeCluster_36FEC56D4E51CB32-001/init-core-data-001
   [junit4]   2> 2130936 INFO  (SUITE-TestLargeCluster-seed#[36FEC56D4E51CB32]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2130936 INFO  (SUITE-TestLargeCluster-seed#[36FEC56D4E51CB32]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 2130937 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 2130937 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
   [junit4]   2> 2130937 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10004_solr, 127.0.0.1:10018_solr, 127.0.0.1:10017_solr, 127.0.0.1:10012_solr, 127.0.0.1:10020_solr, 127.0.0.1:10007_solr, 127.0.0.1:10015_solr, 127.0.0.1:10006_solr, 127.0.0.1:10010_solr, 127.0.0.1:10016_solr, 127.0.0.1:10005_solr, 127.0.0.1:10009_solr, 127.0.0.1:10013_solr, 127.0.0.1:10021_solr, 127.0.0.1:10008_solr, 127.0.0.1:10014_solr, 127.0.0.1:10019_solr, 127.0.0.1:10011_solr]
   [junit4]   2> 2130938 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
   [junit4]   2> 2130938 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
   [junit4]   2> 2130938 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 2130938 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
   [junit4]   2> 2130938 DEBUG (ScheduledTrigger-8708-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 28
   [junit4]   2> 2130942 INFO  (TEST-TestLargeCluster.testNodeLost-seed#[36FEC56D4E51CB32]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLost
   [junit4]   2> 2130942 DEBUG (TEST-TestLargeCluster.testNodeLost-seed#[36FEC56D4E51CB32]) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 2130942 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 2130942 INFO  (TEST-TestLargeCluster.testNodeLost-seed#[36FEC56D4E51CB32]) [    ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
   [junit4]   2> 2130942 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 2130943 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 2130943 WARN  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Interrupted
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2> 	at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1247)
   [junit4]   2> 	at java.base/java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:317)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:165)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 2130943 DEBUG (TEST-TestLargeCluster.testNodeLost-seed#[36FEC56D4E51CB32]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 2130943 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 2130943 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 2130943 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10082_solr, 127.0.0.1:10004_solr, 127.0.0.1:10018_solr, 127.0.0.1:10049_solr, 127.0.0.1:10020_solr, 127.0.0.1:10065_solr, 127.0.0.1:10021_solr, 127.0.0.1:10005_solr, 127.0.0.1:10066_solr, 127.0.0.1:10035_solr, 127.0.0.1:10051_solr, 127.0.0.1:10019_solr, 127.0.0.1:10096_solr, 127.0.0.1:10022_solr, 127.0.0.1:10033_solr, 127.0.0.1:10017_solr, 127.0.0.1:10047_solr, 127.0.0.1:10102_solr, 127.0.0.1:10095_solr, 127.0.0.1:10081_solr, 127.0.0.1:10084_solr, 127.0.0.1:10036_solr, 127.0.0.1:10052_solr, 127.0.0.1:10006_solr, 127.0.0.1:10079_solr, 127.0.0.1:10098_solr, 127.0.0.1:10054_solr, 127.0.0.1:10099_solr, 127.0.0.1:10101_solr, 127.0.0.1:10071_solr, 127.0.0.1:10023_solr, 127.0.0.1:10076_solr, 127.0.0.1:10007_solr, 127.0.0.1:10055_solr, 127.0.0.1:10010_solr, 127.0.0.1:10016_solr, 127.0.0.1:10070_solr, 127.0.0.1:10077_solr, 127.0.0.1:10038_solr, 127.0.0.1:10032_solr, 127.0.0.1:10093_solr, 127.0.0.1:10061_solr, 127.0.0.1:10067_solr, 127.0.0.1:10086_solr, 127.0.0.1:10089_solr, 127.0.0.1:10045_solr, 127.0.0.1:10042_solr, 127.0.0.1:10029_solr, 127.0.0.1:10083_solr, 127.0.0.1:10080_solr, 127.0.0.1:10048_solr, 127.0.0.1:10064_solr, 127.0.0.1:10043_solr, 127.0.0.1:10057_solr, 127.0.0.1:10074_solr, 127.0.0.1:10026_solr, 127.0.0.1:10012_solr, 127.0.0.1:10060_solr, 127.0.0.1:10073_solr, 127.0.0.1:10058_solr, 127.0.0.1:10013_solr, 127.0.0.1:10090_solr, 127.0.0.1:10088_solr, 127.0.0.1:10027_solr, 127.0.0.1:10039_solr, 127.0.0.1:10025_solr, 127.0.0.1:10044_solr, 127.0.0.1:10028_solr, 127.0.0.1:10092_solr, 127.0.0.1:10041_solr, 127.0.0.1:10087_solr, 127.0.0.1:10009_solr, 127.0.0.1:10030_solr, 127.0.0.1:10014_solr, 127.0.0.1:10011_solr, 127.0.0.1:10040_solr, 127.0.0.1:10085_solr, 127.0.0.1:10046_solr, 127.0.0.1:10068_solr, 127.0.0.1:10063_solr, 127.0.0.1:10015_solr, 127.0.0.1:10069_solr, 127.0.0.1:10062_solr, 127.0.0.1:10008_solr, 127.0.0.1:10024_solr, 127.0.0.1:10050_solr, 127.0.0.1:10075_solr, 127.0.0.1:10078_solr, 127.0.0.1:10097_solr, 127.0.0.1:10031_solr, 127.0.0.1:10034_solr, 127.0.0.1:10091_solr, 127.0.0.1:10094_solr, 127.0.0.1:10100_solr, 127.0.0.1:10037_solr, 127.0.0.1:10053_solr, 127.0.0.1:10059_solr, 127.0.0.1:10103_solr, 127.0.0.1:10056_solr, 127.0.0.1:10072_solr]
   [junit4]   2> 2130943 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion -1
   [junit4]   2> 2130943 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 2130944 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 2130944 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 2130944 DEBUG (ScheduledTrigger-8711-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2130964 DEBUG (ScheduledTrigger-8711-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2130984 DEBUG (ScheduledTrigger-8711-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131004 DEBUG (ScheduledTrigger-8711-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131025 DEBUG (ScheduledTrigger-8711-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131045 DEBUG (ScheduledTrigger-8711-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131045 DEBUG (simCloudManagerPool-8710-thread-1) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 2131045 DEBUG (simCloudManagerPool-8710-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 2131046 DEBUG (simCloudManagerPool-8710-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10082_solr, 127.0.0.1:10004_solr, 127.0.0.1:10018_solr, 127.0.0.1:10049_solr, 127.0.0.1:10020_solr, 127.0.0.1:10065_solr, 127.0.0.1:10021_solr, 127.0.0.1:10005_solr, 127.0.0.1:10066_solr, 127.0.0.1:10035_solr, 127.0.0.1:10051_solr, 127.0.0.1:10019_solr, 127.0.0.1:10096_solr, 127.0.0.1:10022_solr, 127.0.0.1:10033_solr, 127.0.0.1:10017_solr, 127.0.0.1:10047_solr, 127.0.0.1:10102_solr, 127.0.0.1:10095_solr, 127.0.0.1:10081_solr, 127.0.0.1:10084_solr, 127.0.0.1:10036_solr, 127.0.0.1:10052_solr, 127.0.0.1:10006_solr, 127.0.0.1:10079_solr, 127.0.0.1:10098_solr, 127.0.0.1:10054_solr, 127.0.0.1:10099_solr, 127.0.0.1:10101_solr, 127.0.0.1:10071_solr, 127.0.0.1:10023_solr, 127.0.0.1:10076_solr, 127.0.0.1:10007_solr, 127.0.0.1:10055_solr, 127.0.0.1:10010_solr, 127.0.0.1:10016_solr, 127.0.0.1:10070_solr, 127.0.0.1:10077_solr, 127.0.0.1:10038_solr, 127.0.0.1:10032_solr, 127.0.0.1:10093_solr, 127.0.0.1:10061_solr, 127.0.0.1:10067_solr, 127.0.0.1:10086_solr, 127.0.0.1:10089_solr, 127.0.0.1:10045_solr, 127.0.0.1:10042_solr, 127.0.0.1:10029_solr, 127.0.0.1:10083_solr, 127.0.0.1:10080_solr, 127.0.0.1:10048_solr, 127.0.0.1:10064_solr, 127.0.0.1:10043_solr, 127.0.0.1:10057_solr, 127.0.0.1:10074_solr, 127.0.0.1:10026_solr, 127.0.0.1:10012_solr, 127.0.0.1:10060_solr, 127.0.0.1:10073_solr, 127.0.0.1:10058_solr, 127.0.0.1:10013_solr, 127.0.0.1:10090_solr, 127.0.0.1:10088_solr, 127.0.0.1:10027_solr, 127.0.0.1:10039_solr, 127.0.0.1:10025_solr, 127.0.0.1:10044_solr, 127.0.0.1:10028_solr, 127.0.0.1:10092_solr, 127.0.0.1:10041_solr, 127.0.0.1:10087_solr, 127.0.0.1:10009_solr, 127.0.0.1:10030_solr, 127.0.0.1:10014_solr, 127.0.0.1:10011_solr, 127.0.0.1:10040_solr, 127.0.0.1:10085_solr, 127.0.0.1:10046_solr, 127.0.0.1:10068_solr, 127.0.0.1:10063_solr, 127.0.0.1:10015_solr, 127.0.0.1:10069_solr, 127.0.0.1:10062_solr, 127.0.0.1:10008_solr, 127.0.0.1:10024_solr, 127.0.0.1:10050_solr, 127.0.0.1:10075_solr, 127.0.0.1:10078_solr, 127.0.0.1:10097_solr, 127.0.0.1:10031_solr, 127.0.0.1:10034_solr, 127.0.0.1:10091_solr, 127.0.0.1:10094_solr, 127.0.0.1:10100_solr, 127.0.0.1:10037_solr, 127.0.0.1:10053_solr, 127.0.0.1:10059_solr, 127.0.0.1:10103_solr, 127.0.0.1:10056_solr, 127.0.0.1:10072_solr]
   [junit4]   2> 2131046 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 2131046 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 2131046 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 2131048 DEBUG (simCloudManagerPool-8710-thread-2) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 2131048 DEBUG (simCloudManagerPool-8710-thread-2) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 2131048 DEBUG (simCloudManagerPool-8710-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10082_solr, 127.0.0.1:10004_solr, 127.0.0.1:10018_solr, 127.0.0.1:10049_solr, 127.0.0.1:10020_solr, 127.0.0.1:10065_solr, 127.0.0.1:10021_solr, 127.0.0.1:10005_solr, 127.0.0.1:10066_solr, 127.0.0.1:10035_solr, 127.0.0.1:10051_solr, 127.0.0.1:10019_solr, 127.0.0.1:10096_solr, 127.0.0.1:10022_solr, 127.0.0.1:10033_solr, 127.0.0.1:10017_solr, 127.0.0.1:10047_solr, 127.0.0.1:10102_solr, 127.0.0.1:10095_solr, 127.0.0.1:10081_solr, 127.0.0.1:10084_solr, 127.0.0.1:10036_solr, 127.0.0.1:10052_solr, 127.0.0.1:10006_solr, 127.0.0.1:10079_solr, 127.0.0.1:10098_solr, 127.0.0.1:10054_solr, 127.0.0.1:10099_solr, 127.0.0.1:10101_solr, 127.0.0.1:10071_solr, 127.0.0.1:10023_solr, 127.0.0.1:10076_solr, 127.0.0.1:10007_solr, 127.0.0.1:10055_solr, 127.0.0.1:10010_solr, 127.0.0.1:10016_solr, 127.0.0.1:10070_solr, 127.0.0.1:10077_solr, 127.0.0.1:10038_solr, 127.0.0.1:10032_solr, 127.0.0.1:10093_solr, 127.0.0.1:10061_solr, 127.0.0.1:10067_solr, 127.0.0.1:10086_solr, 127.0.0.1:10089_solr, 127.0.0.1:10045_solr, 127.0.0.1:10042_solr, 127.0.0.1:10029_solr, 127.0.0.1:10083_solr, 127.0.0.1:10080_solr, 127.0.0.1:10048_solr, 127.0.0.1:10064_solr, 127.0.0.1:10043_solr, 127.0.0.1:10057_solr, 127.0.0.1:10074_solr, 127.0.0.1:10026_solr, 127.0.0.1:10012_solr, 127.0.0.1:10060_solr, 127.0.0.1:10073_solr, 127.0.0.1:10058_solr, 127.0.0.1:10013_solr, 127.0.0.1:10090_solr, 127.0.0.1:10088_solr, 127.0.0.1:10027_solr, 127.0.0.1:10039_solr, 127.0.0.1:10025_solr, 127.0.0.1:10044_solr, 127.0.0.1:10028_solr, 127.0.0.1:10092_solr, 127.0.0.1:10041_solr, 127.0.0.1:10087_solr, 127.0.0.1:10009_solr, 127.0.0.1:10030_solr, 127.0.0.1:10014_solr, 127.0.0.1:10011_solr, 127.0.0.1:10040_solr, 127.0.0.1:10085_solr, 127.0.0.1:10046_solr, 127.0.0.1:10068_solr, 127.0.0.1:10063_solr, 127.0.0.1:10015_solr, 127.0.0.1:10069_solr, 127.0.0.1:10062_solr, 127.0.0.1:10008_solr, 127.0.0.1:10024_solr, 127.0.0.1:10050_solr, 127.0.0.1:10075_solr, 127.0.0.1:10078_solr, 127.0.0.1:10097_solr, 127.0.0.1:10031_solr, 127.0.0.1:10034_solr, 127.0.0.1:10091_solr, 127.0.0.1:10094_solr, 127.0.0.1:10100_solr, 127.0.0.1:10037_solr, 127.0.0.1:10053_solr, 127.0.0.1:10059_solr, 127.0.0.1:10103_solr, 127.0.0.1:10056_solr, 127.0.0.1:10072_solr]
   [junit4]   2> 2131048 DEBUG (simCloudManagerPool-8710-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10082_solr, 127.0.0.1:10004_solr, 127.0.0.1:10018_solr, 127.0.0.1:10049_solr, 127.0.0.1:10020_solr, 127.0.0.1:10065_solr, 127.0.0.1:10021_solr, 127.0.0.1:10005_solr, 127.0.0.1:10066_solr, 127.0.0.1:10035_solr, 127.0.0.1:10051_solr, 127.0.0.1:10019_solr, 127.0.0.1:10096_solr, 127.0.0.1:10022_solr, 127.0.0.1:10033_solr, 127.0.0.1:10017_solr, 127.0.0.1:10047_solr, 127.0.0.1:10102_solr, 127.0.0.1:10095_solr, 127.0.0.1:10081_solr, 127.0.0.1:10084_solr, 127.0.0.1:10036_solr, 127.0.0.1:10052_solr, 127.0.0.1:10006_solr, 127.0.0.1:10079_solr, 127.0.0.1:10098_solr, 127.0.0.1:10054_solr, 127.0.0.1:10099_solr, 127.0.0.1:10101_solr, 127.0.0.1:10071_solr, 127.0.0.1:10023_solr, 127.0.0.1:10076_solr, 127.0.0.1:10007_solr, 127.0.0.1:10055_solr, 127.0.0.1:10010_solr, 127.0.0.1:10016_solr, 127.0.0.1:10070_solr, 127.0.0.1:10077_solr, 127.0.0.1:10038_solr, 127.0.0.1:10032_solr, 127.0.0.1:10093_solr, 127.0.0.1:10061_solr, 127.0.0.1:10067_solr, 127.0.0.1:10086_solr, 127.0.0.1:10089_solr, 127.0.0.1:10045_solr, 127.0.0.1:10042_solr, 127.0.0.1:10029_solr, 127.0.0.1:10083_solr, 127.0.0.1:10080_solr, 127.0.0.1:10048_solr, 127.0.0.1:10064_solr, 127.0.0.1:10043_solr, 127.0.0.1:10057_solr, 127.0.0.1:10074_solr, 127.0.0.1:10026_solr, 127.0.0.1:10012_solr, 127.0.0.1:10060_solr, 127.0.0.1:10073_solr, 127.0.0.1:10058_solr, 127.0.0.1:10013_solr, 127.0.0.1:10090_solr, 127.0.0.1:10088_solr, 127.0.0.1:10027_solr, 127.0.0.1:10039_solr, 127.0.0.1:10025_solr, 127.0.0.1:10044_solr, 127.0.0.1:10028_solr, 127.0.0.1:10092_solr, 127.0.0.1:10041_solr, 127.0.0.1:10087_solr, 127.0.0.1:10009_solr, 127.0.0.1:10030_solr, 127.0.0.1:10014_solr, 127.0.0.1:10011_solr, 127.0.0.1:10040_solr, 127.0.0.1:10085_solr, 127.0.0.1:10046_solr, 127.0.0.1:10068_solr, 127.0.0.1:10063_solr, 127.0.0.1:10015_solr, 127.0.0.1:10069_solr, 127.0.0.1:10062_solr, 127.0.0.1:10008_solr, 127.0.0.1:10024_solr, 127.0.0.1:10050_solr, 127.0.0.1:10075_solr, 127.0.0.1:10078_solr, 127.0.0.1:10097_solr, 127.0.0.1:10031_solr, 127.0.0.1:10034_solr, 127.0.0.1:10091_solr, 127.0.0.1:10094_solr, 127.0.0.1:10100_solr, 127.0.0.1:10037_solr, 127.0.0.1:10053_solr, 127.0.0.1:10059_solr, 127.0.0.1:10103_solr, 127.0.0.1:10056_solr, 127.0.0.1:10072_solr]
   [junit4]   2> 2131048 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 2131048 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 2131048 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 2131048 DEBUG (ScheduledTrigger-8711-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 100
   [junit4]   2> 2131065 DEBUG (ScheduledTrigger-8711-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131071 DEBUG (ScheduledTrigger-8711-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 100
   [junit4]   2> 2131086 DEBUG (ScheduledTrigger-8711-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131092 DEBUG (ScheduledTrigger-8711-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 100
   [junit4]   2> 2131106 DEBUG (ScheduledTrigger-8711-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131112 DEBUG (ScheduledTrigger-8711-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 100
   [junit4]   2> 2131126 DEBUG (ScheduledTrigger-8711-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131133 DEBUG (ScheduledTrigger-8711-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 100
   [junit4]   2> 2131146 DEBUG (ScheduledTrigger-8711-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131153 DEBUG (ScheduledTrigger-8711-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 100
   [junit4]   2> 2131167 DEBUG (ScheduledTrigger-8711-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131173 DEBUG (ScheduledTrigger-8711-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 100
   [junit4]   2> 2131187 DEBUG (ScheduledTrigger-8711-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131193 DEBUG (ScheduledTrigger-8711-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 100
   [junit4]   2> 2131207 DEBUG (ScheduledTrigger-8711-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100
   [junit4]   2> 2131214 DEBUG (ScheduledTrigger-8711-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 100
   [junit4]   2> 21312

[...truncated too long message...]

l.Utils.getDeepCopy(Utils.java:92)
   [junit4]    >         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$224/774717085.apply(Unknown Source)
   [junit4]    >         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
   [junit4]    >         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
   [junit4]    >         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
   [junit4]    >         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
   [junit4]    >         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
   [junit4]    >         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
   [junit4]    >         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
   [junit4]    >         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
   [junit4]    >         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
   [junit4]    >         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$206/14538823.run(Unknown Source)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]    >         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]    >         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$140/1726300375.run(Unknown Source)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    >         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([36FEC56D4E51CB32]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=475, name=AutoscalingActionExecutor-13-thread-1, state=RUNNABLE, group=TGRP-TestLargeCluster]
   [junit4]    >         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:90)
   [junit4]    >         at app//org.apache.solr.common.util.Utils.makeDeepCopy(Utils.java:108)
   [junit4]    >         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:92)
   [junit4]    >         at app//org.apache.solr.common.util.Utils.getDeepCopy(Utils.java:74)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.copy(Row.java:91)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.lambda$getMatrixCopy$1(Policy.java:299)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session$$Lambda$224/774717085.apply(Unknown Source)
   [junit4]    >         at java.base@9.0.4/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
   [junit4]    >         at java.base@9.0.4/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1494)
   [junit4]    >         at java.base@9.0.4/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
   [junit4]    >         at java.base@9.0.4/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
   [junit4]    >         at java.base@9.0.4/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
   [junit4]    >         at java.base@9.0.4/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
   [junit4]    >         at java.base@9.0.4/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:511)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
   [junit4]    >         at app//org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
   [junit4]    >         at app//org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
   [junit4]    >         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:308)
   [junit4]    >         at app//org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$206/14538823.run(Unknown Source)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]    >         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]    >         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$140/1726300375.run(Unknown Source)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]    >         at java.base@9.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    >         at java.base@9.0.4/java.lang.Thread.run(Thread.java:844)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([36FEC56D4E51CB32]:0)
   [junit4] Completed [5/5 (3!)] on J1 in 64.84s, 4 tests, 2 errors <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 36FEC56D4E51CB32]:
   [junit4]   - org.apache.solr.cloud.autoscaling.sim.TestLargeCluster (suite)
   [junit4]   - org.apache.solr.cloud.autoscaling.sim.TestLargeCluster (suite)
   [junit4]   - org.apache.solr.cloud.autoscaling.sim.TestLargeCluster (suite)
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     1.79 ..    67.14 =    65.35s
   [junit4] JVM J1:     1.79 ..    67.94 =    66.14s
   [junit4] JVM J2:     1.82 ..    67.60 =    65.78s
   [junit4] Execution time total: 1 minute 7 seconds
   [junit4] Tests summary: 5 suites, 20 tests, 6 suite-level errors, 8 ignored

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 20 tests, 6 suite-level errors, 8 ignored [seed: 36FEC56D4E51CB32]

Total time: 1 minute 10 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   3/5 failed: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster
[repro]   5/5 failed: org.apache.solr.ltr.TestLTRReRankingPipeline
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=bd83a339474f34c91e0f2e9a1057ef43ede645d7, workspace=/var/lib/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #8
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2