You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/03/29 13:52:04 UTC

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1769 - Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1769/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC

11 tests failed.
FAILED:  org.apache.solr.search.TestRecovery.testBuffering

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs

Error Message:
mismatch: '6'!='3' @ response/numFound

Stack Trace:
java.lang.RuntimeException: mismatch: '6'!='3' @ response/numFound
	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:6FF2D052738B7DB1]:0)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1002)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:949)
	at org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs(TestRecovery.java:1448)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.TestRecovery.testBuffering

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs

Error Message:
mismatch: '6'!='3' @ response/numFound

Stack Trace:
java.lang.RuntimeException: mismatch: '6'!='3' @ response/numFound
	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:6FF2D052738B7DB1]:0)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1002)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:949)
	at org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs(TestRecovery.java:1448)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.TestRecovery.testBuffering

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs

Error Message:
mismatch: '6'!='3' @ response/numFound

Stack Trace:
java.lang.RuntimeException: mismatch: '6'!='3' @ response/numFound
	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:6FF2D052738B7DB1]:0)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1002)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:949)
	at org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs(TestRecovery.java:1448)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.TestRecovery.testBuffering

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.TestRecovery.testBuffering

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs

Error Message:
mismatch: '6'!='3' @ response/numFound

Stack Trace:
java.lang.RuntimeException: mismatch: '6'!='3' @ response/numFound
	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:6FF2D052738B7DB1]:0)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1002)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:949)
	at org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs(TestRecovery.java:1448)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.TestRecovery.testBuffering

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs

Error Message:
mismatch: '6'!='3' @ response/numFound

Stack Trace:
java.lang.RuntimeException: mismatch: '6'!='3' @ response/numFound
	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:6FF2D052738B7DB1]:0)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1002)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:949)
	at org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs(TestRecovery.java:1448)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 1842 lines...]
   [junit4] JVM J1: stdout was not empty, see: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/build/core/test/temp/junit4-J1-20180329_115835_2837085927597754245769.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] codec: Lucene70, pf: RAMOnly, dvf: Memory
   [junit4] <<< JVM J1: EOF ----

[...truncated 11483 lines...]
   [junit4] Suite: org.apache.solr.search.TestRecovery
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-001/init-core-data-001
   [junit4]   2> 1976708 WARN  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=18 numCloses=18
   [junit4]   2> 1976708 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1976710 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1976710 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1976710 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 updateLog impl=solr.UpdateLog
   [junit4]   2> 1976710 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 1976711 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1976732 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1976753 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 1976819 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1976857 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1976863 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1976863 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1976864 INFO  (coreLoadExecutor-7355-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1976864 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1976889 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1976913 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1976978 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1976984 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 1976984 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1976984 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1976984 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-001/init-core-data-001/]
   [junit4]   2> 1976987 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34304518368427706]
   [junit4]   2> 1977014 WARN  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1977070 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1977071 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1977071 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1977072 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1977073 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=48.427734375, floorSegmentMB=0.83984375, forceMergeDeletesPctAllowed=8.616976919946959, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1977073 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@ba57ea4[collection1] main]
   [junit4]   2> 1977074 WARN  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 1977074 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1977076 INFO  (searcherExecutor-7356-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@ba57ea4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1977076 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596276841216212992
   [junit4]   2> 1977079 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 1977082 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testVersionsOnRestart
   [junit4]   2> 1977083 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1977085 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@a5de1ff[collection1] realtime]
   [junit4]   2> 1977085 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 1
   [junit4]   2> 1977085 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596276841225650176,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1977085 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6cbaf3c2 commitCommandVersion:1596276841225650176
   [junit4]   2> 1977095 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@22275867[collection1] main]
   [junit4]   2> 1977095 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1977096 INFO  (searcherExecutor-7356-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@22275867[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1977096 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 11
   [junit4]   2> 1977099 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[D1 (1596276841239281664)]} 0 1
   [junit4]   2> 1977099 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[D2 (1596276841240330240)]} 0 0
   [junit4]   2> 1977099 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596276841240330241,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1977099 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6cbaf3c2 commitCommandVersion:1596276841240330241
   [junit4]   2> 1977130 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b8af8ac[collection1] main]
   [junit4]   2> 1977130 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1977132 INFO  (searcherExecutor-7356-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2b8af8ac[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):c2)))}
   [junit4]   2> 1977132 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 33
   [junit4]   2> 1977133 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:D1&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 1977134 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:D2&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 1977134 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=618159072
   [junit4]   2> 1977134 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1977134 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@79ce74b4: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3a759dd5
   [junit4]   2> 1977138 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1977138 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7e634c9e: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7f7e01c0
   [junit4]   2> 1977140 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1977140 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@77bcddcc: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4a9954dd
   [junit4]   2> 1977141 INFO  (coreCloseExecutor-7361-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1ce3edb5
   [junit4]   2> 1977141 INFO  (coreCloseExecutor-7361-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1ce3edb5
   [junit4]   2> 1977141 INFO  (coreCloseExecutor-7361-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6b8df480: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@288cef6
   [junit4]   2> 1977153 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1977173 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1977183 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 1977255 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1977303 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1977311 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1977311 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1977312 INFO  (coreLoadExecutor-7368-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1977313 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1977332 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1977339 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1977395 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1977401 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 1977401 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1977401 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1977401 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-001/init-core-data-001/]
   [junit4]   2> 1977405 WARN  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1977446 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1977446 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1977446 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1977447 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1977447 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34304518368427706]
   [junit4]   2> 1977449 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b9f2dde[collection1] main]
   [junit4]   2> 1977449 WARN  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 1977450 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1977450 INFO  (searcherExecutor-7369-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3b9f2dde[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):c2)))}
   [junit4]   2> 1977453 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[D1 (1596276841610477568)]} 0 1
   [junit4]   2> 1977453 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596276841611526144,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1977453 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@39327486 commitCommandVersion:1596276841611526144
   [junit4]   2> 1977703 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@37aee0f0[collection1] main]
   [junit4]   2> 1977704 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1977705 INFO  (searcherExecutor-7369-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@37aee0f0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):c2/1:delGen=1) Uninverting(_1(8.0.0):c1)))}
   [junit4]   2> 1977705 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 252
   [junit4]   2> 1977706 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:D1&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 1977707 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&getVersions=2&wt=xml} status=0 QTime=0
   [junit4]   2> 1977708 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testVersionsOnRestart
   [junit4]   2> 1977714 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLogReplayWithReorderedDBQByAsterixAndChildDocs
   [junit4]   2> 1977715 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1977716 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@616dca23[collection1] realtime]
   [junit4]   2> 1977716 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
   [junit4]   2> 1977716 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596276841887301632,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1977716 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@39327486 commitCommandVersion:1596276841887301632
   [junit4]   2> 1977728 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6211b1fe[collection1] main]
   [junit4]   2> 1977728 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1977730 INFO  (searcherExecutor-7369-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6211b1fe[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1977730 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 14
   [junit4]   2> 1977732 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[RDBQ2_1 (2)]} 0 0
   [junit4]   2> 1977732 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[RDBQ2_2 (5)]} 0 0
   [junit4]   2> 1977736 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@478e9c69[collection1] realtime]
   [junit4]   2> 1977738 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@38622721[collection1] realtime]
   [junit4]   2> 1977738 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&_version_=-4&wt=json&indent=true}{deleteByQuery=_root_:RDBQ2_1 _root_:RDBQ2_2 id:RDBQ2_3 _root_:RDBQ2_4 (-4)} 0 6
   [junit4]   2> 1977738 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 Reordered DBQs detected.  Update=add{_version_=3,id=RDBQ2_3} DBQs=[DBQ{version=4,q=_root_:RDBQ2_1 _root_:RDBQ2_2 id:RDBQ2_3 _root_:RDBQ2_4}]
   [junit4]   2> 1977748 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7207c1d[collection1] realtime]
   [junit4]   2> 1977748 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[RDBQ2_3 (3)]} 0 10
   [junit4]   2> 1977749 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[RDBQ2_4 (6)]} 0 0
   [junit4]   2> 1977749 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 1977749 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=974864582
   [junit4]   2> 1977749 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1977749 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3a53f5d1: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@5643cb13
   [junit4]   2> 1977755 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1977755 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@63bfd2eb: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7f7e01c0
   [junit4]   2> 1977758 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1977758 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6c21feab: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4a9954dd
   [junit4]   2> 1977759 INFO  (coreCloseExecutor-7374-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@47825cae
   [junit4]   2> 1977759 INFO  (coreCloseExecutor-7374-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=47825cae
   [junit4]   2> 1977759 INFO  (coreCloseExecutor-7374-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@42503ab8: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@5401755e
   [junit4]   2> 1977767 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1977785 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1977793 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 1977852 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1977886 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1977892 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1977892 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1977893 INFO  (coreLoadExecutor-7381-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1977893 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1977918 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1977928 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1977988 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1977993 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 1977993 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
   [junit4]   2> 1977993 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1977993 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-001/init-core-data-001/]
   [junit4]   2> 1977997 WARN  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1978030 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1978030 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1978032 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1978032 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1978032 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34304518368427706]
   [junit4]   2> 1978033 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@25eef4ab[collection1] main]
   [junit4]   2> 1978033 WARN  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 1978034 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1978034 INFO  (searcherExecutor-7382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@25eef4ab[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1978035 WARN  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.UpdateLog Starting log replay tlog{file=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-001/init-core-data-001/tlog/tlog.0000000000000000004 refcount=2} active=false starting pos=0 inSortedOrder=false
   [junit4]   2> 1978036 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 1978043 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2441d6aa[collection1] realtime]
   [junit4]   2> 1978044 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@12a0a9bc[collection1] realtime]
   [junit4]   2> 1978044 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 Reordered DBQs detected.  Update=add{flags=a,_version_=3,id=RDBQ2_3} DBQs=[DBQ{version=4,q=_root_:RDBQ2_1 _root_:RDBQ2_2 id:RDBQ2_3 _root_:RDBQ2_4}]
   [junit4]   2> 1978048 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@38ad88f2[collection1] realtime]
   [junit4]   2> 1978049 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{flags=2,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1978049 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@40890820 commitCommandVersion:0
   [junit4]   2> 1978085 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7c3cf18e[collection1] main]
   [junit4]   2> 1978085 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1978086 INFO  (searcherExecutor-7382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7c3cf18e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(8.0.0):c6/3:delGen=1) Uninverting(_5(8.0.0):c3)))}
   [junit4]   2> 1978087 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[RDBQ2_1 (2), RDBQ2_2 (5), RDBQ2_3 (3), RDBQ2_4 (6)],deleteByQuery=_root_:RDBQ2_1 _root_:RDBQ2_2 id:RDBQ2_3 _root_:RDBQ2_4 (-4)} 0 51
   [junit4]   2> 1978087 WARN  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.UpdateLog Log replay finished. recoveryInfo=RecoveryInfo{adds=4 deletes=0 deleteByQuery=1 errors=0 positionOfStart=0}
   [junit4]   2> 1978087 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=6 status=0 QTime=0
   [junit4]   2> 1978087 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testLogReplayWithReorderedDBQByAsterixAndChildDocs
   [junit4]   2> 1978091 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCleanShutdown
   [junit4]   2> 1978091 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1978092 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3bfa3698[collection1] realtime]
   [junit4]   2> 1978092 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
   [junit4]   2> 1978092 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596276842281566208,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1978092 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@40890820 commitCommandVersion:1596276842281566208
   [junit4]   2> 1978102 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3db6a4cc[collection1] main]
   [junit4]   2> 1978102 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1978103 INFO  (searcherExecutor-7382-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3db6a4cc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1978104 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 11
   [junit4]   2> 1978105 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[E1 (1596276842294149120)]} 0 1
   [junit4]   2> 1978106 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[E2 (1596276842295197696)]} 0 0
   [junit4]   2> 1978106 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2057475401
   [junit4]   2> 1978106 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1978106 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@12e1b36f: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@342a679c
   [junit4]   2> 1978111 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr

[...truncated too long message...]

overy.testReload-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6ee13cc[collection1] realtime]
   [junit4]   2> 73261 INFO  (TEST-TestRecovery.testReload-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=foo_t:hownowbrowncow (-1596280249756155904)} 0 5
   [junit4]   2> 73261 INFO  (TEST-TestRecovery.testReload-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[reload1 (1596280249762447360)]} 0 0
   [junit4]   2> 73262 INFO  (TEST-TestRecovery.testReload-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testReload
   [junit4] OK      0.21s J0 | TestRecovery.testReload
   [junit4]   2> 73264 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Starting testBuffering
   [junit4]   2> 73265 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 73265 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@17c0e568[collection1] realtime]
   [junit4]   2> 73266 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 1
   [junit4]   2> 73266 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596280249767690240,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 73266 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@75d8099b commitCommandVersion:1596280249767690240
   [junit4]   2> 73275 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3a5d0a26[collection1] main]
   [junit4]   2> 73276 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 73277 INFO  (searcherExecutor-1008-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3a5d0a26[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 73278 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 12
   [junit4]   2> 73278 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 73278 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 73279 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testBuffering
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestRecovery -Dtests.method=testBuffering -Dtests.seed=D6674863F4F03A58 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=lt -Dtests.timezone=Africa/Conakry -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.02s J0 | TestRecovery.testBuffering <<<
   [junit4]    > Throwable #1: java.lang.NullPointerException
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
   [junit4]    > 	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] IGNOR/A 0.01s J0 | TestRecovery.testRecoveryMultipleLogs
   [junit4]    > Assumption #1: Ignored, failures limit reached (5 >= 5).
   [junit4]   2> 73285 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 73285 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2121935719
   [junit4]   2> 73285 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 73285 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@53ebf6a0: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3ec28f90
   [junit4]   2> 73288 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 73288 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2ab4b003: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3dbd939a
   [junit4]   2> 73288 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 73288 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3c59d44a: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@122fa483
   [junit4]   2> 73288 INFO  (coreCloseExecutor-1012-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@568efe64
   [junit4]   2> 73288 INFO  (coreCloseExecutor-1012-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=568efe64
   [junit4]   2> 73288 INFO  (coreCloseExecutor-1012-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@270c41b3: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@338f2d3c
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-003
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {_root_=Lucene50(blocksize=128), id=FSTOrd50}, docValues:{_version_=DocValuesFormat(name=Lucene70), val_i_dvo=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=647, maxMBSortInHeap=6.830494683367925, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@7ac28831), locale=lt, timezone=Africa/Conakry
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=1,free=128930056,total=314572800
   [junit4]   2> NOTE: All tests run in this JVM: [TestRecovery, TestRecovery, TestRecovery]
   [junit4] Completed [5/5 (5!)] on J0 in 10.46s, 19 tests, 1 error, 1 skipped <<< FAILURES!

[...truncated 18 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1568: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1092: There were test failures: 5 suites, 95 tests, 9 errors, 1 ignored (1 assumption) [seed: D6674863F4F03A58]

Total time: 1 minute 19 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.search.TestRecovery
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=668b81721fa5b539d9286ed2f464426a598c352a, workspace=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris
[WARNINGS] Computing warning deltas based on reference build #1765
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1773 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Error processing tokens: Error while parsing action 'Text/ZeroOrMore/FirstOf/Token/DelimitedToken/DelimitedToken_Action3' at input position (line 79, pos 4):
)"}
   ^

java.lang.OutOfMemoryError: Java heap space

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1772 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1772/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC

5 tests failed.
FAILED:  org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest

Error Message:
Deleted core was still loaded!

Stack Trace:
java.lang.AssertionError: Deleted core was still loaded!
	at __randomizedtesting.SeedInfo.seed([AAA5E07EF8568323:679B7B8DB7F7F5C1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest(DeleteInactiveReplicaTest.java:86)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest

Error Message:
Deleted core was still loaded!

Stack Trace:
java.lang.AssertionError: Deleted core was still loaded!
	at __randomizedtesting.SeedInfo.seed([AAA5E07EF8568323:679B7B8DB7F7F5C1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest(DeleteInactiveReplicaTest.java:86)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest

Error Message:
Deleted core was still loaded!

Stack Trace:
java.lang.AssertionError: Deleted core was still loaded!
	at __randomizedtesting.SeedInfo.seed([AAA5E07EF8568323:679B7B8DB7F7F5C1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest(DeleteInactiveReplicaTest.java:86)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest

Error Message:
Deleted core was still loaded!

Stack Trace:
java.lang.AssertionError: Deleted core was still loaded!
	at __randomizedtesting.SeedInfo.seed([AAA5E07EF8568323:679B7B8DB7F7F5C1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest(DeleteInactiveReplicaTest.java:86)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest

Error Message:
Deleted core was still loaded!

Stack Trace:
java.lang.AssertionError: Deleted core was still loaded!
	at __randomizedtesting.SeedInfo.seed([AAA5E07EF8568323:679B7B8DB7F7F5C1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest(DeleteInactiveReplicaTest.java:86)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 1853 lines...]
   [junit4] JVM J1: stdout was not empty, see: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/build/core/test/temp/junit4-J1-20180330_135907_1633503524769851707358.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] codec: HighCompressionCompressingStoredFields, pf: Direct, dvf: Asserting
   [junit4] <<< JVM J1: EOF ----

[...truncated 10463 lines...]
   [junit4] Suite: org.apache.solr.cloud.DeleteInactiveReplicaTest
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/init-core-data-001
   [junit4]   2> 297157 WARN  (SUITE-DeleteInactiveReplicaTest-seed#[AAA5E07EF8568323]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 297157 INFO  (SUITE-DeleteInactiveReplicaTest-seed#[AAA5E07EF8568323]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 297158 INFO  (SUITE-DeleteInactiveReplicaTest-seed#[AAA5E07EF8568323]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 297159 INFO  (SUITE-DeleteInactiveReplicaTest-seed#[AAA5E07EF8568323]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 297159 INFO  (SUITE-DeleteInactiveReplicaTest-seed#[AAA5E07EF8568323]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001
   [junit4]   2> 297159 INFO  (SUITE-DeleteInactiveReplicaTest-seed#[AAA5E07EF8568323]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 297159 INFO  (Thread-1290) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 297159 INFO  (Thread-1290) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 297161 ERROR (Thread-1290) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 297259 INFO  (SUITE-DeleteInactiveReplicaTest-seed#[AAA5E07EF8568323]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:34200
   [junit4]   2> 297262 INFO  (zkConnectionManagerCallback-705-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297286 INFO  (jetty-launcher-702-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 297287 INFO  (jetty-launcher-702-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 297287 INFO  (jetty-launcher-702-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 297287 INFO  (jetty-launcher-702-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 297287 INFO  (jetty-launcher-702-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 297287 INFO  (jetty-launcher-702-thread-4) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 297289 INFO  (jetty-launcher-702-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 297289 INFO  (jetty-launcher-702-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 297289 INFO  (jetty-launcher-702-thread-3) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 297289 INFO  (jetty-launcher-702-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@49b9a43{/solr,null,AVAILABLE}
   [junit4]   2> 297290 INFO  (jetty-launcher-702-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 297290 INFO  (jetty-launcher-702-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 297291 INFO  (jetty-launcher-702-thread-4) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 297291 INFO  (jetty-launcher-702-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@55a5c28b{/solr,null,AVAILABLE}
   [junit4]   2> 297292 INFO  (jetty-launcher-702-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 297292 INFO  (jetty-launcher-702-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3dea333c{/solr,null,AVAILABLE}
   [junit4]   2> 297293 INFO  (jetty-launcher-702-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 297293 INFO  (jetty-launcher-702-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 297295 INFO  (jetty-launcher-702-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 297295 INFO  (jetty-launcher-702-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5911aeed{/solr,null,AVAILABLE}
   [junit4]   2> 297314 INFO  (jetty-launcher-702-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7870679c{SSL,[ssl, http/1.1]}{127.0.0.1:54034}
   [junit4]   2> 297314 INFO  (jetty-launcher-702-thread-3) [    ] o.e.j.s.Server Started @297674ms
   [junit4]   2> 297314 INFO  (jetty-launcher-702-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=54034}
   [junit4]   2> 297314 ERROR (jetty-launcher-702-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 297314 INFO  (jetty-launcher-702-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 297314 INFO  (jetty-launcher-702-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 297315 INFO  (jetty-launcher-702-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 297315 INFO  (jetty-launcher-702-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 297315 INFO  (jetty-launcher-702-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-30T14:21:20.851Z
   [junit4]   2> 297315 INFO  (jetty-launcher-702-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5ad9212f{SSL,[ssl, http/1.1]}{127.0.0.1:34241}
   [junit4]   2> 297315 INFO  (jetty-launcher-702-thread-4) [    ] o.e.j.s.Server Started @297674ms
   [junit4]   2> 297315 INFO  (jetty-launcher-702-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34241}
   [junit4]   2> 297315 ERROR (jetty-launcher-702-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@66b4f43f{SSL,[ssl, http/1.1]}{127.0.0.1:36191}
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-1) [    ] o.e.j.s.Server Started @297675ms
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36191}
   [junit4]   2> 297315 INFO  (jetty-launcher-702-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@68b6c04f{SSL,[ssl, http/1.1]}{127.0.0.1:48980}
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-2) [    ] o.e.j.s.Server Started @297676ms
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=48980}
   [junit4]   2> 297316 ERROR (jetty-launcher-702-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 297316 ERROR (jetty-launcher-702-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-30T14:21:20.852Z
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 297316 INFO  (jetty-launcher-702-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-30T14:21:20.852Z
   [junit4]   2> 297317 INFO  (jetty-launcher-702-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 297317 INFO  (jetty-launcher-702-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 297317 INFO  (jetty-launcher-702-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 297317 INFO  (jetty-launcher-702-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 297317 INFO  (jetty-launcher-702-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-03-30T14:21:20.853Z
   [junit4]   2> 297317 INFO  (zkConnectionManagerCallback-707-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297318 INFO  (jetty-launcher-702-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 297319 INFO  (zkConnectionManagerCallback-709-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297319 INFO  (zkConnectionManagerCallback-711-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297320 INFO  (jetty-launcher-702-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 297320 INFO  (jetty-launcher-702-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 297333 INFO  (zkConnectionManagerCallback-713-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297334 INFO  (jetty-launcher-702-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34200/solr
   [junit4]   2> 297336 INFO  (zkConnectionManagerCallback-718-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297336 INFO  (jetty-launcher-702-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34200/solr
   [junit4]   2> 297336 INFO  (jetty-launcher-702-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34200/solr
   [junit4]   2> 297337 INFO  (jetty-launcher-702-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 297341 INFO  (zkConnectionManagerCallback-723-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297341 INFO  (zkConnectionManagerCallback-727-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297343 INFO  (zkConnectionManagerCallback-725-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297346 INFO  (jetty-launcher-702-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34200/solr
   [junit4]   2> 297350 INFO  (zkConnectionManagerCallback-729-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297353 INFO  (zkConnectionManagerCallback-732-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297354 INFO  (zkConnectionManagerCallback-735-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297359 INFO  (zkConnectionManagerCallback-738-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297379 INFO  (jetty-launcher-702-thread-1) [n:127.0.0.1:36191_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 297379 INFO  (jetty-launcher-702-thread-4) [n:127.0.0.1:34241_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 297380 INFO  (jetty-launcher-702-thread-1) [n:127.0.0.1:36191_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36191_solr
   [junit4]   2> 297381 INFO  (jetty-launcher-702-thread-4) [n:127.0.0.1:34241_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34241_solr
   [junit4]   2> 297383 INFO  (jetty-launcher-702-thread-1) [n:127.0.0.1:36191_solr    ] o.a.s.c.Overseer Overseer (id=72149165496467465-127.0.0.1:36191_solr-n_0000000000) starting
   [junit4]   2> 297390 INFO  (zkCallback-728-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 297391 INFO  (zkCallback-737-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 297399 INFO  (zkConnectionManagerCallback-745-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297401 INFO  (jetty-launcher-702-thread-1) [n:127.0.0.1:36191_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 297407 INFO  (jetty-launcher-702-thread-1) [n:127.0.0.1:36191_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34200/solr ready
   [junit4]   2> 297417 INFO  (jetty-launcher-702-thread-1) [n:127.0.0.1:36191_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 297417 INFO  (jetty-launcher-702-thread-1) [n:127.0.0.1:36191_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36191_solr
   [junit4]   2> 297445 INFO  (zkCallback-728-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 297451 INFO  (zkCallback-737-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 297452 INFO  (zkCallback-744-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 297477 INFO  (jetty-launcher-702-thread-2) [n:127.0.0.1:48980_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 297481 INFO  (jetty-launcher-702-thread-2) [n:127.0.0.1:48980_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 297484 INFO  (jetty-launcher-702-thread-2) [n:127.0.0.1:48980_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 297484 INFO  (jetty-launcher-702-thread-2) [n:127.0.0.1:48980_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48980_solr
   [junit4]   2> 297486 INFO  (zkCallback-737-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 297486 INFO  (zkCallback-744-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 297486 INFO  (zkCallback-728-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 297495 INFO  (jetty-launcher-702-thread-3) [n:127.0.0.1:54034_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 297497 INFO  (jetty-launcher-702-thread-3) [n:127.0.0.1:54034_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 297498 INFO  (jetty-launcher-702-thread-3) [n:127.0.0.1:54034_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 297499 INFO  (jetty-launcher-702-thread-3) [n:127.0.0.1:54034_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54034_solr
   [junit4]   2> 297508 INFO  (zkCallback-731-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 297509 INFO  (zkCallback-731-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 297510 INFO  (zkCallback-726-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 297510 INFO  (zkCallback-744-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 297510 INFO  (zkCallback-728-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 297510 INFO  (zkCallback-737-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 297808 INFO  (jetty-launcher-702-thread-4) [n:127.0.0.1:34241_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34241.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 297817 INFO  (jetty-launcher-702-thread-4) [n:127.0.0.1:34241_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34241.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 297817 INFO  (jetty-launcher-702-thread-4) [n:127.0.0.1:34241_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34241.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 297826 INFO  (jetty-launcher-702-thread-4) [n:127.0.0.1:34241_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node4/.
   [junit4]   2> 297832 INFO  (zkConnectionManagerCallback-749-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297833 INFO  (jetty-launcher-702-thread-4) [n:127.0.0.1:34241_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 297834 INFO  (jetty-launcher-702-thread-4) [n:127.0.0.1:34241_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34200/solr ready
   [junit4]   2> 297943 INFO  (jetty-launcher-702-thread-2) [n:127.0.0.1:48980_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48980.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 297948 INFO  (jetty-launcher-702-thread-2) [n:127.0.0.1:48980_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48980.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 297948 INFO  (jetty-launcher-702-thread-2) [n:127.0.0.1:48980_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48980.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 297948 INFO  (jetty-launcher-702-thread-2) [n:127.0.0.1:48980_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node2/.
   [junit4]   2> 297953 INFO  (zkConnectionManagerCallback-753-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 297954 INFO  (jetty-launcher-702-thread-2) [n:127.0.0.1:48980_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 297955 INFO  (jetty-launcher-702-thread-2) [n:127.0.0.1:48980_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34200/solr ready
   [junit4]   2> 298452 INFO  (jetty-launcher-702-thread-3) [n:127.0.0.1:54034_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54034.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 298458 INFO  (jetty-launcher-702-thread-3) [n:127.0.0.1:54034_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54034.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 298458 INFO  (jetty-launcher-702-thread-3) [n:127.0.0.1:54034_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54034.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 298460 INFO  (jetty-launcher-702-thread-3) [n:127.0.0.1:54034_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node3/.
   [junit4]   2> 298463 INFO  (zkConnectionManagerCallback-757-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 298465 INFO  (jetty-launcher-702-thread-3) [n:127.0.0.1:54034_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 298466 INFO  (jetty-launcher-702-thread-3) [n:127.0.0.1:54034_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34200/solr ready
   [junit4]   2> 299023 INFO  (jetty-launcher-702-thread-1) [n:127.0.0.1:36191_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36191.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 299027 INFO  (jetty-launcher-702-thread-1) [n:127.0.0.1:36191_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36191.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 299028 INFO  (jetty-launcher-702-thread-1) [n:127.0.0.1:36191_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36191.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 299028 INFO  (jetty-launcher-702-thread-1) [n:127.0.0.1:36191_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node1/.
   [junit4]   2> 299061 INFO  (zkConnectionManagerCallback-759-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 299065 INFO  (zkConnectionManagerCallback-763-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 299067 INFO  (SUITE-DeleteInactiveReplicaTest-seed#[AAA5E07EF8568323]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 299068 INFO  (SUITE-DeleteInactiveReplicaTest-seed#[AAA5E07EF8568323]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34200/solr ready
   [junit4]   2> 299108 INFO  (TEST-DeleteInactiveReplicaTest.deleteInactiveReplicaTest-seed#[AAA5E07EF8568323]) [    ] o.a.s.SolrTestCaseJ4 ###Starting deleteInactiveReplicaTest
   [junit4]   2> 299188 INFO  (qtp1046092579-3405) [n:127.0.0.1:54034_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&name=delDeadColl&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 299191 INFO  (OverseerThreadFactory-865-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection delDeadColl
   [junit4]   2> 299304 INFO  (OverseerStateUpdate-72149165496467465-127.0.0.1:36191_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"delDeadColl",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"delDeadColl_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:54034/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 299308 INFO  (OverseerStateUpdate-72149165496467465-127.0.0.1:36191_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"delDeadColl",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"delDeadColl_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36191/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 299311 INFO  (OverseerStateUpdate-72149165496467465-127.0.0.1:36191_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"delDeadColl",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"delDeadColl_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:48980/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 299314 INFO  (OverseerStateUpdate-72149165496467465-127.0.0.1:36191_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"delDeadColl",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"delDeadColl_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34241/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 299563 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=delDeadColl_shard1_replica_n1&action=CREATE&numShards=2&collection=delDeadColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 299582 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=delDeadColl_shard1_replica_n2&action=CREATE&numShards=2&collection=delDeadColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 299584 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=delDeadColl_shard2_replica_n6&action=CREATE&numShards=2&collection=delDeadColl&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 299584 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=delDeadColl_shard2_replica_n4&action=CREATE&numShards=2&collection=delDeadColl&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 299584 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 299750 INFO  (zkCallback-728-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 299750 INFO  (zkCallback-737-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 299750 INFO  (zkCallback-731-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 299750 INFO  (zkCallback-726-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 299751 INFO  (zkCallback-726-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 299751 INFO  (zkCallback-731-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 299751 INFO  (zkCallback-737-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 299752 INFO  (zkCallback-728-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 300605 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 300606 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 300608 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 300612 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.s.IndexSchema [delDeadColl_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 300613 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.s.IndexSchema [delDeadColl_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 300613 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 300615 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 300615 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'delDeadColl_shard1_replica_n1' using configuration from collection delDeadColl, trusted=true
   [junit4]   2> 300615 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 300615 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'delDeadColl_shard1_replica_n2' using configuration from collection delDeadColl, trusted=true
   [junit4]   2> 300615 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54034.solr.core.delDeadColl.shard1.replica_n1' (registry 'solr.core.delDeadColl.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 300615 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 300615 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36191.solr.core.delDeadColl.shard1.replica_n2' (registry 'solr.core.delDeadColl.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 300615 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.c.SolrCore [[delDeadColl_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node3/delDeadColl_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node3/./delDeadColl_shard1_replica_n1/data/]
   [junit4]   2> 300616 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 300616 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.SolrCore [[delDeadColl_shard1_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node1/delDeadColl_shard1_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node1/./delDeadColl_shard1_replica_n2/data/]
   [junit4]   2> 300618 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.s.IndexSchema [delDeadColl_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 300619 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 300619 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'delDeadColl_shard2_replica_n6' using configuration from collection delDeadColl, trusted=true
   [junit4]   2> 300620 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34241.solr.core.delDeadColl.shard2.replica_n6' (registry 'solr.core.delDeadColl.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 300620 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 300620 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.SolrCore [[delDeadColl_shard2_replica_n6] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node4/delDeadColl_shard2_replica_n6], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node4/./delDeadColl_shard2_replica_n6/data/]
   [junit4]   2> 300633 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.s.IndexSchema [delDeadColl_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 300634 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 300634 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'delDeadColl_shard2_replica_n4' using configuration from collection delDeadColl, trusted=true
   [junit4]   2> 300638 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48980.solr.core.delDeadColl.shard2.replica_n4' (registry 'solr.core.delDeadColl.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14b64a47
   [junit4]   2> 300640 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 300640 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.c.SolrCore [[delDeadColl_shard2_replica_n4] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node2/delDeadColl_shard2_replica_n4], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-001/tempDir-001/node2/./delDeadColl_shard2_replica_n4/data/]
   [junit4]   2> 300996 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 300996 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 300997 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 300997 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 301000 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@74d5401c[delDeadColl_shard2_replica_n6] main]
   [junit4]   2> 301006 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 301006 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 301007 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 301008 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596372743140409344
   [junit4]   2> 301013 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 301013 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 301013 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 301014 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 301015 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@36f1d242[delDeadColl_shard1_replica_n2] main]
   [junit4]   2> 301017 INFO  (searcherExecutor-876-thread-1-processing-n:127.0.0.1:34241_solr x:delDeadColl_shard2_replica_n6 c:delDeadColl s:shard2 r:core_node8) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.SolrCore [delDeadColl_shard2_replica_n6] Registered new searcher Searcher@74d5401c[delDeadColl_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 301018 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 301018 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 301018 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 301019 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596372743151943680
   [junit4]   2> 301022 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/delDeadColl/terms/shard2 to Terms{values={core_node8=0}, version=0}
   [junit4]   2> 301028 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 301028 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 301028 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 301030 INFO  (searcherExecutor-875-thread-1-processing-n:127.0.0.1:36191_solr x:delDeadColl_shard1_replica_n2 c:delDeadColl s:shard1 r:core_node5) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.SolrCore [delDeadColl_shard1_replica_n2] Registered new searcher Searcher@36f1d242[delDeadColl_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 301031 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/delDeadColl/terms/shard1 to Terms{values={core_node5=0}, version=0}
   [junit4]   2> 301036 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 301037 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 301037 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 301041 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 301041 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 301042 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 301042 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 301044 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@460373d3[delDeadColl_shard1_replica_n1] main]
   [junit4]   2> 301045 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 301045 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 301046 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 301046 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596372743180255232
   [junit4]   2> 301049 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@31c6d48c[delDeadColl_shard2_replica_n4] main]
   [junit4]   2> 301049 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/delDeadColl/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
   [junit4]   2> 301052 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 301052 INFO  (searcherExecutor-874-thread-1-processing-n:127.0.0.1:54034_solr x:delDeadColl_shard1_replica_n1 c:delDeadColl s:shard1 r:core_node3) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.c.SolrCore [delDeadColl_shard1_replica_n1] Registered new searcher Searcher@460373d3[delDeadColl_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 301052 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 301053 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 301053 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596372743187595264
   [junit4]   2> 301059 INFO  (searcherExecutor-877-thread-1-processing-n:127.0.0.1:48980_solr x:delDeadColl_shard2_replica_n4 c:delDeadColl s:shard2 r:core_node7) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.c.SolrCore [delDeadColl_shard2_replica_n4] Registered new searcher Searcher@31c6d48c[delDeadColl_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 301061 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/delDeadColl/terms/shard2 to Terms{values={core_node7=0, core_node8=0}, version=1}
   [junit4]   2> 301138 INFO  (zkCallback-726-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301138 INFO  (zkCallback-737-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301138 INFO  (zkCallback-728-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301138 INFO  (zkCallback-726-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301138 INFO  (zkCallback-728-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301139 INFO  (zkCallback-737-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301139 INFO  (zkCallback-731-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301140 INFO  (zkCallback-731-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301531 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 301531 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 301531 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:34241/solr/delDeadColl_shard2_replica_n6/
   [junit4]   2> 301531 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=delDeadColl_shard2_replica_n6 url=https://127.0.0.1:34241/solr START replicas=[https://127.0.0.1:48980/solr/delDeadColl_shard2_replica_n4/] nUpdates=100
   [junit4]   2> 301538 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 301539 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 301539 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:36191/solr/delDeadColl_shard1_replica_n2/
   [junit4]   2> 301539 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=delDeadColl_shard1_replica_n2 url=https://127.0.0.1:36191/solr START replicas=[https://127.0.0.1:54034/solr/delDeadColl_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 301545 INFO  (qtp1858053354-3429) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.c.S.Request [delDeadColl_shard2_replica_n4]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 301553 INFO  (qtp1046092579-3408) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.c.S.Request [delDeadColl_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 301833 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=delDeadColl_shard2_replica_n6 url=https://127.0.0.1:34241/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 301833 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 301833 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 301833 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 301838 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:34241/solr/delDeadColl_shard2_replica_n6/ shard2
   [junit4]   2> 301841 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=delDeadColl_shard1_replica_n2 url=https://127.0.0.1:36191/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 301841 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 301841 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 301841 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 301846 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:36191/solr/delDeadColl_shard1_replica_n2/ shard1
   [junit4]   2> 301950 INFO  (zkCallback-726-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301950 INFO  (zkCallback-728-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301950 INFO  (zkCallback-737-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301950 INFO  (zkCallback-737-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301950 INFO  (zkCallback-731-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301950 INFO  (zkCallback-731-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301950 INFO  (zkCallback-728-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301950 INFO  (zkCallback-726-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 301994 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 301997 INFO  (qtp599502989-3419) [n:127.0.0.1:34241_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=delDeadColl_shard2_replica_n6&action=CREATE&numShards=2&collection=delDeadColl&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2414
   [junit4]   2> 301998 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 302001 INFO  (qtp1422480622-3400) [n:127.0.0.1:36191_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=delDeadColl_shard1_replica_n2&action=CREATE&numShards=2&collection=delDeadColl&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2419
   [junit4]   2> 302066 INFO  (qtp1046092579-3406) [n:127.0.0.1:54034_solr c:delDeadColl s:shard1 r:core_node3 x:delDeadColl_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=delDeadColl_shard1_replica_n1&action=CREATE&numShards=2&collection=delDeadColl&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2503
   [junit4]   2> 302070 INFO  (qtp1858053354-3427) [n:127.0.0.1:48980_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=delDeadColl_shard2_replica_n4&action=CREATE&numShards=2&collection=delDeadColl&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2486
   [junit4]   2> 302074 INFO  (qtp1046092579-3405) [n:127.0.0.1:54034_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 302171 INFO  (zkCallback-728-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 302171 INFO  (zkCallback-731-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 302171 INFO  (zkCallback-728-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 302171 INFO  (zkCallback-726-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 302171 INFO  (zkCallback-737-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 302171 INFO  (zkCallback-731-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 302171 INFO  (zkCallback-737-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 302172 INFO  (zkCallback-726-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delDeadColl/state.json] for collection [delDeadColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 303075 INFO  (qtp1046092579-3405) [n:127.0.0.1:54034_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&name=delDeadColl&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=3888
   [junit4]   2> 303080 INFO  (TEST-DeleteInactiveReplicaTest.deleteInactiveReplicaTest-seed#[AAA5E07EF8568323]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@7870679c{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 303081 INFO  (TEST-DeleteInactiveReplicaTest.deleteInactiveReplicaTest-seed#[AAA5E07EF8568323]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1811650971
   [junit4]   2> 303081 INFO  (TEST-DeleteInactiveReplicaTest.deleteInactiveReplicaTest-seed#[AAA5E07EF8568323]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 303081 INFO  (TEST-DeleteInactiveReplicaTest.deleteInactiveReplicaTest-seed#[AAA5E07EF8568323]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3a07ac67: rootName = solr_54034, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2809ec36
   [junit4]   2> 303086 INFO  (TEST-DeleteInactiveReplicaTest.deleteInactiveReplicaTest-seed#[AAA5E07EF8568323]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 303086 INFO  (TEST-DeleteInactiveReplicaTest.deleteInactiveReplicaTest-seed#[AAA5E07EF8568323]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4e221ee2: rootName = solr_54034, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3db77ce8
   [junit4]   2> 303088 INFO  (TEST-DeleteInactiveReplicaTest.deleteInactiveReplicaTest-seed#[AAA5E07EF8568323]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 303088 INFO  (TEST-DeleteInactiveReplicaTest.deleteInactiveReplicaTest-seed#[AAA5E07EF8568323]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6bea15e8: rootName = solr_54034, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@34826615
   [junit4]   2> 303093 INFO  (TEST-DeleteInactiveRe

[...truncated too long message...]

m ZooKeeper... (2) -> (1)
   [junit4]   2> 64663 INFO  (zkCallback-201-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 64663 INFO  (zkCallback-183-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 64663 INFO  (zkCallback-224-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 64664 INFO  (zkCallback-175-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 64664 INFO  (zkCallback-224-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 64664 INFO  (jetty-closer-152-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 64664 INFO  (zkCallback-181-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 64666 INFO  (zkCallback-183-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 64666 INFO  (jetty-closer-152-thread-4) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 64667 INFO  (zkCallback-201-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 64667 INFO  (zkCallback-205-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 64668 INFO  (zkCallback-219-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 64668 INFO  (zkCallback-175-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 64669 INFO  (zkCallback-193-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
   [junit4]   2> 64671 INFO  (coreCloseExecutor-190-thread-1) [n:127.0.0.1:35816_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.c.SolrCore [delDeadColl_shard2_replica_n6]  CLOSING SolrCore org.apache.solr.core.SolrCore@58e0b7a3
   [junit4]   2> 64671 INFO  (coreCloseExecutor-190-thread-1) [n:127.0.0.1:35816_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.delDeadColl.shard2.replica_n6, tag=58e0b7a3
   [junit4]   2> 64671 INFO  (coreCloseExecutor-190-thread-1) [n:127.0.0.1:35816_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@65cfa659: rootName = solr_35816, domain = solr.core.delDeadColl.shard2.replica_n6, service url = null, agent id = null] for registry solr.core.delDeadColl.shard2.replica_n6 / com.codahale.metrics.MetricRegistry@23d87e66
   [junit4]   2> 64676 INFO  (jetty-closer-152-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5ce58bcf{/solr,null,UNAVAILABLE}
   [junit4]   2> 64676 INFO  (jetty-closer-152-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 64727 INFO  (coreCloseExecutor-187-thread-1) [n:127.0.0.1:60675_solr c:delDeadColl s:shard2 r:core_node7 x:delDeadColl_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.delDeadColl.shard2.leader, tag=723159dd
   [junit4]   2> 64731 INFO  (coreCloseExecutor-188-thread-1) [n:127.0.0.1:36460_solr c:delDeadColl s:shard1 r:core_node5 x:delDeadColl_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.delDeadColl.shard1.leader, tag=1059755f
   [junit4]   2> 64736 INFO  (jetty-closer-152-thread-2) [    ] o.a.s.c.Overseer Overseer (id=72149448792801290-127.0.0.1:60675_solr-n_0000000000) closing
   [junit4]   2> 64736 INFO  (OverseerStateUpdate-72149448792801290-127.0.0.1:60675_solr-n_0000000000) [    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60675_solr
   [junit4]   2> 64737 WARN  (OverseerAutoScalingTriggerThread-72149448792801290-127.0.0.1:60675_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 64750 INFO  (zkCallback-175-thread-1) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35816_solr
   [junit4]   2> 64754 INFO  (jetty-closer-152-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@75075211{/solr,null,UNAVAILABLE}
   [junit4]   2> 64754 INFO  (jetty-closer-152-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 64756 INFO  (coreCloseExecutor-190-thread-1) [n:127.0.0.1:35816_solr c:delDeadColl s:shard2 r:core_node8 x:delDeadColl_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.delDeadColl.shard2.leader, tag=58e0b7a3
   [junit4]   2> 64759 INFO  (jetty-closer-152-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@544a84ef{/solr,null,UNAVAILABLE}
   [junit4]   2> 64760 INFO  (jetty-closer-152-thread-3) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 64772 INFO  (jetty-closer-152-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@26c8cadd{/solr,null,UNAVAILABLE}
   [junit4]   2> 64772 INFO  (jetty-closer-152-thread-4) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 64774 ERROR (SUITE-DeleteInactiveReplicaTest-seed#[AAA5E07EF8568323]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 64775 INFO  (SUITE-DeleteInactiveReplicaTest-seed#[AAA5E07EF8568323]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52030 52030
   [junit4]   2> 64917 INFO  (Thread-105) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52030 52030
   [junit4]   2> 64919 WARN  (Thread-105) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/aliases.json
   [junit4]   2> 	5	/solr/collections/delDeadColl/terms/shard2
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/collections/delDeadColl/terms/shard1
   [junit4]   2> 	4	/solr/configs/conf
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	32	/solr/collections/delDeadColl/state.json
   [junit4]   2> 	11	/solr/clusterstate.json
   [junit4]   2> 	11	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72149448792801290-127.0.0.1:60675_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/live_nodes
   [junit4]   2> 	11	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteInactiveReplicaTest_AAA5E07EF8568323-003
   [junit4]   2> Mar 30, 2018 3:33:37 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=537, maxMBSortInHeap=7.047027530508478, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4c77cd89), locale=sq, timezone=America/Coral_Harbour
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=1,free=75734168,total=234881024
   [junit4]   2> NOTE: All tests run in this JVM: [DeleteInactiveReplicaTest, DeleteInactiveReplicaTest, DeleteInactiveReplicaTest]
   [junit4] Completed [5/5 (5!)] on J1 in 17.68s, 1 test, 1 failure <<< FAILURES!

[...truncated 14 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1568: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1092: There were test failures: 5 suites, 5 tests, 5 failures [seed: AAA5E07EF8568323]

Total time: 1 minute 8 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.cloud.DeleteInactiveReplicaTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=35bfe897901f1b51bce654b49aecd9560bfa797f, workspace=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris
[WARNINGS] Computing warning deltas based on reference build #1770
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1771 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1771/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

All tests passed

Build Log:
[...truncated 1849 lines...]
   [junit4] JVM J1: stdout was not empty, see: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/build/core/test/temp/junit4-J1-20180330_064739_7465096954604185012658.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] codec: FastDecompressionCompressingStoredFields, pf: Asserting, dvf: Lucene70
   [junit4] <<< JVM J1: EOF ----

[...truncated 10128 lines...]
    [javac] Compiling 887 source files to /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/classes/test
    [javac] /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test/org/apache/solr/cloud/autoscaling/ScheduledTriggerIntegrationTest.java:50: error: cannot find symbol
    [javac] @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 26-Mar-2018
    [javac]  ^
    [javac]   symbol: class BadApple
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] 1 error

BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/build.xml:633: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/build.xml:577: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/build.xml:59: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build.xml:262: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/common-build.xml:557: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:896: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:908: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:2052: Compile failed; see the compiler error output for details.

Total time: 25 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1770 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1770/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.search.TestStressRecovery.testStressRecovery

Error Message:
Captured an uncaught exception in thread: Thread[id=27706, name=READER3, state=RUNNABLE, group=TGRP-TestStressRecovery]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=27706, name=READER3, state=RUNNABLE, group=TGRP-TestStressRecovery]
	at __randomizedtesting.SeedInfo.seed([F746DE6363639A6:B54E04BBA9DE86A8]:0)
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([F746DE6363639A6]:0)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:332)
Caused by: java.lang.NullPointerException
	at org.apache.solr.update.TransactionLog.lookup(TransactionLog.java:520)
	at org.apache.solr.update.UpdateLog.lookup(UpdateLog.java:980)
	at org.apache.solr.handler.component.RealTimeGetComponent.process(RealTimeGetComponent.java:236)
	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:295)
	at org.apache.solr.handler.RealTimeGetHandler.handleRequestBody(RealTimeGetHandler.java:46)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2508)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)




Build Log:
[...truncated 1846 lines...]
   [junit4] JVM J1: stdout was not empty, see: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/build/core/test/temp/junit4-J1-20180329_203611_9986907444613648827695.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] codec: DummyCompressingStoredFields, pf: Memory, dvf: Asserting
   [junit4] <<< JVM J1: EOF ----

[...truncated 11929 lines...]
   [junit4] Suite: org.apache.solr.search.TestStressRecovery
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.search.TestStressRecovery_F746DE6363639A6-001/init-core-data-001
   [junit4]   2> 2508266 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2508283 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2508290 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 2508342 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2508375 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c19f931
   [junit4]   2> 2508380 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c19f931
   [junit4]   2> 2508380 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c19f931
   [junit4]   2> 2508381 INFO  (coreLoadExecutor-8301-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2508381 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2508409 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2508415 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 2508466 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2508471 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 2508471 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c19f931
   [junit4]   2> 2508471 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2508471 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.search.TestStressRecovery_F746DE6363639A6-001/init-core-data-001/]
   [junit4]   2> 2508472 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=30.9541015625, floorSegmentMB=1.6689453125, forceMergeDeletesPctAllowed=2.822743035710592, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2508475 WARN  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2508514 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 2508514 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2508514 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2508514 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2508515 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=59.1591796875, floorSegmentMB=1.330078125, forceMergeDeletesPctAllowed=24.44838411343268, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7482764438498778
   [junit4]   2> 2508515 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@9546c00[collection1] main]
   [junit4]   2> 2508515 WARN  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 2508516 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2508516 INFO  (coreLoadExecutor-8301-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596309442040692736
   [junit4]   2> 2508516 INFO  (searcherExecutor-8302-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@9546c00[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2508520 INFO  (TEST-TestStressRecovery.testStressRecovery-seed#[F746DE6363639A6]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2508521 INFO  (TEST-TestStressRecovery.testStressRecovery-seed#[F746DE6363639A6]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@12061402[collection1] realtime]
   [junit4]   2> 2508521 INFO  (TEST-TestStressRecovery.testStressRecovery-seed#[F746DE6363639A6]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
   [junit4]   2> 2508521 INFO  (TEST-TestStressRecovery.testStressRecovery-seed#[F746DE6363639A6]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596309442045935616,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2508521 INFO  (TEST-TestStressRecovery.testStressRecovery-seed#[F746DE6363639A6]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3410bbaa commitCommandVersion:1596309442045935616
   [junit4]   2> 2508522 INFO  (TEST-TestStressRecovery.testStressRecovery-seed#[F746DE6363639A6]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4431c787[collection1] main]
   [junit4]   2> 2508522 INFO  (TEST-TestStressRecovery.testStressRecovery-seed#[F746DE6363639A6]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2508523 INFO  (searcherExecutor-8302-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4431c787[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2508523 INFO  (TEST-TestStressRecovery.testStressRecovery-seed#[F746DE6363639A6]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 2
   [junit4]   2> 2508529 INFO  (WRITER0) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596309442054324224,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 2508529 INFO  (WRITER0) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2508532 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:14&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508532 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508532 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:9&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508533 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:91&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508533 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508533 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-1&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{delete=[0 (-1)]} 0 4
   [junit4]   2> 2508534 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-2&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{delete=[0 (-2)]} 0 0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=170&wt=json} status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:29&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=23&wt=json} status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=77&wt=json} status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=43&wt=json} status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=188&wt=json} status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=9&wt=json} status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=134&wt=json} status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=103&wt=json} status=0 QTime=1
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=11&wt=json} status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:140&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=123&wt=json} status=0 QTime=0
   [junit4]   2> 2508534 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:181&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=132&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=149&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=117&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=167&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=4&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=148&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=27&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=97&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=6&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=7&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=51&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=117&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=165&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=164&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508535 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:39&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:166&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:98&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=152&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=16&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=168&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=78&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=154&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=113&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=184&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=79&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:8&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:169&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=76&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=97&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=76&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=110&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=110&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=6&wt=json} status=0 QTime=0
   [junit4]   2> 2508536 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=62&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=111&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=83&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:143&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=58&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=140&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=119&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=117&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=26&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:4&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=90&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=19&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=152&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=58&wt=json} status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508537 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:78&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:52&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=6&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=82&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=122&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:8&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=116&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=172&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=134&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:138&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:167&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=2&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=148&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:162&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=136&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:182&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=180&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:137&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=109&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508538 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=105&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=14&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=107&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=105&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=85&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:109&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=154&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=115&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:133&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:59&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=177&wt=json} status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508539 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=161&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=59&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=148&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=137&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=96&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=60&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:15&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:171&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=108&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:124&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=30&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=88&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=49&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=182&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:89&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=190&wt=json} status=0 QTime=0
   [junit4]   2> 2508540 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=3&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=8&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:126&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:188&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=117&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=17&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=179&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=100&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=37&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=48&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:102&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=40&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=170&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=185&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=73&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=169&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=115&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:171&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=19&wt=json} status=0 QTime=0
   [junit4]   2> 2508541 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:20&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=49&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=85&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=175&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=177&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=77&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=157&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=59&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:31&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=161&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:146&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=130&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=131&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=140&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=114&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=140&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=186&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=105&wt=json} status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:52&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508542 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=118&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:48&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=186&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:54&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:155&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=66&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=5&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=91&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=147&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=44&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=171&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=47&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:178&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=68&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:75&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=101&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:68&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508543 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=41&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=137&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=16&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=113&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=6&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:166&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:123&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:19&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:95&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:27&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=53&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=7&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=82&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=164&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=74&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:177&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=182&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=31&wt=json} status=0 QTime=0
   [junit4]   2> 2508544 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=66&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=160&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=147&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=183&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=12&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=64&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=190&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:14&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=26&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=44&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=141&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:21&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=13&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:14&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:20&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:84&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=7&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=82&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=173&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508545 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=6&wt=json} status=0 QTime=0
   [junit4]   2> 2508546 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=15
   [junit4]   2> 2508546 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 17
   [junit4]   2> 2508546 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=159&wt=json} status=0 QTime=0
   [junit4]   2> 2508546 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=85&wt=json} status=0 QTime=0
   [junit4]   2> 2508546 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=73&wt=json} status=0 QTime=0
   [junit4]   2> 2508547 INFO  (WRITER0) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596309442073198592,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 2508547 INFO  (WRITER0) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:36&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=95&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=164&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=41&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=25&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:179&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=159&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=65&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=173&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=20&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=107&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=42&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=102&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:77&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=102&wt=json} status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:118&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:158&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:151&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508548 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:158&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=105&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=14&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=10&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=44&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=11&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:109&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=108&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:122&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=53&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=130&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=130&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:120&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=112&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=91&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:157&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=112&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:18&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=189&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=146&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=33&wt=json} status=0 QTime=0
   [junit4]   2> 2508549 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=103&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=18&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:107&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=153&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=147&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=76&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:190&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=70&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=95&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=171&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=138&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:98&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=139&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=162&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:173&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:81&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=166&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=109&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:80&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508550 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:61&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=139&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=81&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=126&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=26&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=183&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=95&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=132&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=85&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=170&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=17&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=174&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=187&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=4&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=1&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=67&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:176&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:97&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508551 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=56&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:3&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=56&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=103&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=28&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=169&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=41&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:104&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:108&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=52&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=45&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=53&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=128&wt=json} status=0 QTime=17
   [junit4]   2> 2508552 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=134&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=10&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=105&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=104&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=13&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=150&wt=json} status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=7
   [junit4]   2> 2508552 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:36&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508552 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=81&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=99&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:33&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:169&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=37&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=12&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=97&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:115&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=47&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=133&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=139&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:154&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER3) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:76&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=36&wt=json} status=0 QTime=0
   [junit4]   2> 2508553 INFO  (READER1) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:78&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508553 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 5
   [junit4]   2> 2508553 INFO  (WRITER0) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596309442079490048,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 2508554 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:122&omitHeader=true&wt=json} hits=0 status=0 QTime=7
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=20&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=186&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=120&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=15&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=120&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:65&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:191&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=187&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=154&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=34&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=174&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:120&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=140&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:168&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:84&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508554 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=39&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=189&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=82&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:139&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:6&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=51&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=52&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=9&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=60&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=106&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=35&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:39&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=83&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=111&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:38&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=186&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=55&wt=json} status=0 QTime=0
   [junit4]   2> 2508555 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:105&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=135&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=63&wt=json} status=0 QTime=1
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=24&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:17&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=54&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=115&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=91&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=20&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=0&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=148&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:0&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:29&omitHeader=true&wt=json} hits=0 status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=40&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=57&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER2) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&ids=10&wt=json} status=0 QTime=0
   [junit4]   2> 2508556 INFO  (READER0) [    ] o.a.s.c.S.Request [

[...truncated too long message...]

apache.solr.util.TestHarness.query(TestHarness.java:319)
   [junit4]    > 	at org.apache.solr.search.TestStressRecovery$2.run(TestStressRecovery.java:307)
   [junit4]   2> 2514096 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1238143887
   [junit4]   2> 2514096 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2514096 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3da2a4dd: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@92f9541
   [junit4]   2> 2514099 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2514099 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6c591cdb: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5b392558
   [junit4]   2> 2514101 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2514101 INFO  (SUITE-TestStressRecovery-seed#[F746DE6363639A6]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6b8d09f6: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1d2fb4f6
   [junit4]   2> 2514101 INFO  (coreCloseExecutor-8307-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@57ef74de
   [junit4]   2> 2514102 INFO  (coreCloseExecutor-8307-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=57ef74de
   [junit4]   2> 2514102 INFO  (coreCloseExecutor-8307-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5c892bfd: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@5bedc1e2
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1325, maxMBSortInHeap=5.599642819796423, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3774924b), locale=sl-SI, timezone=Australia/Yancowinna
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=1,free=103901720,total=516337664
   [junit4]   2> NOTE: All tests run in this JVM: [HdfsDirectoryFactoryTest, BasicDistributedZk2Test, ConjunctionSolrSpellCheckerTest, URLClassifyProcessorTest, IndexSchemaTest, TestExclusionRuleCollectionAccess, TestIndexingPerformance, DistributedTermsComponentTest, CollectionsAPIDistributedZkTest, ConcurrentCreateRoutedAliasTest, TestRTGBase, HDFSCollectionsAPITest, TestCloudManagedSchema, AutoAddReplicasIntegrationTest, TestLMDirichletSimilarityFactory, UUIDFieldTest, ClusterStateUpdateTest, TestBulkSchemaAPI, TestCollectionAPI, TestSolrCoreProperties, TestSortableTextField, TestCSVLoader, ClassificationUpdateProcessorIntegrationTest, TestShortCircuitedRequests, JsonLoaderTest, RegexBoostProcessorTest, TestSubQueryTransformerDistrib, ChaosMonkeyNothingIsSafeWithPullReplicasTest, InfoHandlerTest, ZkFailoverTest, V2StandaloneTest, TestDistribStateManager, BadComponentTest, SimpleFacetsTest, TestDocTermOrds, ScheduledMaintenanceTriggerTest, TestEmbeddedSolrServerAdminHandler, TestGraphMLResponseWriter, PreAnalyzedFieldTest, QueryParsingTest, TestSolrIndexConfig, TestExportWriter, SolrShardReporterTest, TestSQLHandler, DistributedQueryComponentOptimizationTest, PreAnalyzedUpdateProcessorTest, StressHdfsTest, TestManagedStopFilterFactory, TestFuzzyAnalyzedSuggestions, TestRandomFlRTGCloud, DistanceFunctionTest, SolrCoreMetricManagerTest, TestFieldCollectionResource, FullHLLTest, TestTriggerIntegration, OverriddenZkACLAndCredentialsProvidersTest, TestStressUserVersions, HdfsChaosMonkeySafeLeaderTest, SliceStateTest, BlockJoinFacetDistribTest, TestSSLRandomization, TestDynamicLoading, TestConfigSetsAPI, TestSearchPerf, NoCacheHeaderTest, DistributedFacetPivotLargeTest, ShowFileRequestHandlerTest, TestNumericRangeQuery32, BasicAuthStandaloneTest, UpdateParamsTest, TestFieldCacheSortRandom, TestQuerySenderListener, CdcrReplicationDistributedZkTest, OverseerStatusTest, CustomCollectionTest, TestReplicaProperties, CloudExitableDirectoryReaderTest, ImplicitSnitchTest, TestTolerantUpdateProcessorCloud, SolrCoreCheckLockOnStartupTest, SolrIndexMetricsTest, FacetPivotSmallTest, TestLMJelinekMercerSimilarityFactory, ReplicaListTransformerTest, IndexBasedSpellCheckerTest, SolrCmdDistributorTest, CoreAdminCreateDiscoverTest, TestPolicyCloud, TestConfigReload, TestBadConfig, ConfigureRecoveryStrategyTest, TestCloudNestedDocsSort, TestRandomCollapseQParserPlugin, TestPHPSerializedResponseWriter, TestDistributedMissingSort, DistributedFacetPivotWhiteBoxTest, CheckHdfsIndexTest, TestClusterStateProvider, BooleanFieldTest, SoftAutoCommitTest, CdcrRequestHandlerTest, DOMUtilTest, TestCoreDiscovery, TestDistributedSearch, TestEmbeddedSolrServerSchemaAPI, TestBackupRepositoryFactory, NodeMutatorTest, NotRequiredUniqueKeyTest, SubstringBytesRefFilterTest, TestReloadDeadlock, TestCollapseQParserPlugin, TestExpandComponent, SegmentsInfoRequestHandlerTest, DistributedFacetSimpleRefinementLongTailTest, TestHighFrequencyDictionaryFactory, TestConfigSetsAPIZkFailure, TestInPlaceUpdatesDistrib, TestSkipOverseerOperations, TestMaxScoreQueryParser, TestSortByMinMaxFunction, TestPolicyCloud, TestAtomicUpdateErrorCases, TestDynamicFieldCollectionResource, TestMultiWordSynonyms, TestRawTransformer, TestJsonRequest, ConnectionReuseTest, TestSubQueryTransformer, AtomicUpdatesTest, HdfsDirectoryTest, AnalyticsQueryTest, LeaderFailoverAfterPartitionTest, SuggesterWFSTTest, TestPullReplica, LeaderVoteWaitTimeoutTest, RemoteQueryErrorTest, BitVectorTest, TestFieldSortValues, DeleteReplicaTest, ExecutePlanActionTest, TestCloudSearcherWarming, DirectoryFactoryTest, TestDocumentBuilder, AnalysisErrorHandlingTest, TestValueSourceCache, DeleteLastCustomShardedReplicaTest, TestInitQParser, ReturnFieldsTest, TestComplexPhraseQParserPlugin, SimplePostToolTest, TestConfigSets, DeleteStatusTest, ShardSplitTest, TestAuthorizationFramework, ChaosMonkeySafeLeaderTest, TestManagedResourceStorage, SimpleMLTQParserTest, TimeRoutedAliasUpdateProcessorTest, SolrMetricReporterTest, TestGenericDistributedQueue, TestOverriddenPrefixQueryForCustomFieldType, TestUtilizeNode, TestNodeAddedTrigger, TestAnalyzedSuggestions, DebugComponentTest, PropertiesRequestHandlerTest, RequestHandlersTest, RequestLoggingTest, CollectionStateFormat2Test, TestDFISimilarityFactory, PrimitiveFieldTypeTest, CurrencyFieldTypeTest, MoveReplicaHDFSFailoverTest, CursorMarkTest, TestRandomDVFaceting, OverseerModifyCollectionTest, ConnectionManagerTest, TestSystemCollAutoCreate, JavabinLoaderTest, MergeStrategyTest, TestCrossCoreJoin, TestSolrFieldCacheBean, CloneFieldUpdateProcessorFactoryTest, CSVRequestHandlerTest, TestBinaryResponseWriter, TestLockTree, TestCloudDeleteByQuery, TestSchemaManager, AutoScalingHandlerTest, SchemaApiFailureTest, UpdateLogTest, TestFastWriter, HdfsThreadLeakTest, ZkControllerTest, TestHashPartitioner, TestCustomStream, LeaderElectionIntegrationTest, BasicZkTest, FullSolrCloudDistribCmdsTest, ZkSolrClientTest, DistributedSpellCheckComponentTest, TestStressReorder, TestStressVersions, TestCoreContainer, SpellCheckComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFiltering, BasicFunctionalityTest, DirectUpdateHandlerTest, AnalysisAfterCoreReloadTest, SpellCheckCollatorTest, SolrRequestParserTest, DocValuesTest, StatelessScriptUpdateProcessorFactoryTest, TestSolrDeletionPolicy1, TestSurroundQueryParser, LukeRequestHandlerTest, TestReversedWildcardFilterFactory, TestQueryTypes, TermsComponentTest, TestSolrQueryParser, LoggingHandlerTest, UpdateRequestProcessorFactoryTest, UniqFieldsUpdateProcessorFactoryTest, PingRequestHandlerTest, TestComponentsName, TestLFUCache, HighlighterConfigTest, TestQuerySenderNoQuery, ResponseLogComponentTest, TestStressRecovery]
   [junit4] Completed [476/786 (1!)] on J1 in 5.86s, 1 test, 1 error <<< FAILURES!

[...truncated 50525 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1770/consoleText

[repro] Revision: b5a36785738a299cb00933c2d55c587917a2d9ab

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line:  ant test  -Dtestcase=TestStressRecovery -Dtests.method=testStressRecovery -Dtests.seed=F746DE6363639A6 -Dtests.slow=true -Dtests.locale=sl-SI -Dtests.timezone=Australia/Yancowinna -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestStressRecovery
[repro] ant compile-test

[...truncated 3317 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestStressRecovery" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=F746DE6363639A6 -Dtests.slow=true -Dtests.locale=sl-SI -Dtests.timezone=Australia/Yancowinna -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 68 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.search.TestStressRecovery
[repro] Exiting with code 0

[...truncated 70 lines...]

Re: [JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1769 - Unstable!

Posted by Steve Rowe <sa...@gmail.com>.
+1

Docs, changes and javadocs look good.

Smoke tester says: SUCCESS! [0:35:05.242678]

--
Steve
www.lucidworks.com

> On Mar 29, 2018, at 9:52 AM, Policeman Jenkins Server <je...@thetaphi.de> wrote:
> 
> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1769/
> Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC
> 
> 11 tests failed.
> FAILED:  org.apache.solr.search.TestRecovery.testBuffering
> 
> Error Message:
> 
> 
> Stack Trace:
> java.lang.NullPointerException
> 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
> 	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at java.lang.Thread.run(Thread.java:748)
> 
> 
> FAILED:  org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs
> 
> Error Message:
> mismatch: '6'!='3' @ response/numFound
> 
> Stack Trace:
> java.lang.RuntimeException: mismatch: '6'!='3' @ response/numFound
> 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:6FF2D052738B7DB1]:0)
> 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1002)
> 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:949)
> 	at org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs(TestRecovery.java:1448)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at java.lang.Thread.run(Thread.java:748)
> 
> 
> FAILED:  org.apache.solr.search.TestRecovery.testBuffering
> 
> Error Message:
> 
> 
> Stack Trace:
> java.lang.NullPointerException
> 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
> 	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at java.lang.Thread.run(Thread.java:748)
> 
> 
> FAILED:  org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs
> 
> Error Message:
> mismatch: '6'!='3' @ response/numFound
> 
> Stack Trace:
> java.lang.RuntimeException: mismatch: '6'!='3' @ response/numFound
> 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:6FF2D052738B7DB1]:0)
> 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1002)
> 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:949)
> 	at org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs(TestRecovery.java:1448)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at java.lang.Thread.run(Thread.java:748)
> 
> 
> FAILED:  org.apache.solr.search.TestRecovery.testBuffering
> 
> Error Message:
> 
> 
> Stack Trace:
> java.lang.NullPointerException
> 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
> 	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at java.lang.Thread.run(Thread.java:748)
> 
> 
> FAILED:  org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs
> 
> Error Message:
> mismatch: '6'!='3' @ response/numFound
> 
> Stack Trace:
> java.lang.RuntimeException: mismatch: '6'!='3' @ response/numFound
> 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:6FF2D052738B7DB1]:0)
> 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1002)
> 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:949)
> 	at org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs(TestRecovery.java:1448)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at java.lang.Thread.run(Thread.java:748)
> 
> 
> FAILED:  org.apache.solr.search.TestRecovery.testBuffering
> 
> Error Message:
> 
> 
> Stack Trace:
> java.lang.NullPointerException
> 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
> 	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at java.lang.Thread.run(Thread.java:748)
> 
> 
> FAILED:  org.apache.solr.search.TestRecovery.testBuffering
> 
> Error Message:
> 
> 
> Stack Trace:
> java.lang.NullPointerException
> 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
> 	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at java.lang.Thread.run(Thread.java:748)
> 
> 
> FAILED:  org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs
> 
> Error Message:
> mismatch: '6'!='3' @ response/numFound
> 
> Stack Trace:
> java.lang.RuntimeException: mismatch: '6'!='3' @ response/numFound
> 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:6FF2D052738B7DB1]:0)
> 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1002)
> 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:949)
> 	at org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs(TestRecovery.java:1448)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at java.lang.Thread.run(Thread.java:748)
> 
> 
> FAILED:  org.apache.solr.search.TestRecovery.testBuffering
> 
> Error Message:
> 
> 
> Stack Trace:
> java.lang.NullPointerException
> 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
> 	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at java.lang.Thread.run(Thread.java:748)
> 
> 
> FAILED:  org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs
> 
> Error Message:
> mismatch: '6'!='3' @ response/numFound
> 
> Stack Trace:
> java.lang.RuntimeException: mismatch: '6'!='3' @ response/numFound
> 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:6FF2D052738B7DB1]:0)
> 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1002)
> 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:949)
> 	at org.apache.solr.search.TestRecovery.testRecoveryMultipleLogs(TestRecovery.java:1448)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> 	at java.lang.Thread.run(Thread.java:748)
> 
> 
> 
> 
> Build Log:
> [...truncated 1842 lines...]
>   [junit4] JVM J1: stdout was not empty, see: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/build/core/test/temp/junit4-J1-20180329_115835_2837085927597754245769.sysout
>   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
>   [junit4] codec: Lucene70, pf: RAMOnly, dvf: Memory
>   [junit4] <<< JVM J1: EOF ----
> 
> [...truncated 11483 lines...]
>   [junit4] Suite: org.apache.solr.search.TestRecovery
>   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-001/init-core-data-001
>   [junit4]   2> 1976708 WARN  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=18 numCloses=18
>   [junit4]   2> 1976708 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
>   [junit4]   2> 1976710 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
>   [junit4]   2> 1976710 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
>   [junit4]   2> 1976710 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 updateLog impl=solr.UpdateLog
>   [junit4]   2> 1976710 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
>   [junit4]   2> 1976711 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
>   [junit4]   2> 1976732 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
>   [junit4]   2> 1976753 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
>   [junit4]   2> 1976819 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>   [junit4]   2> 1976857 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1976863 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1976863 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1976864 INFO  (coreLoadExecutor-7355-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
>   [junit4]   2> 1976864 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
>   [junit4]   2> 1976889 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
>   [junit4]   2> 1976913 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
>   [junit4]   2> 1976978 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>   [junit4]   2> 1976984 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
>   [junit4]   2> 1976984 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1976984 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
>   [junit4]   2> 1976984 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-001/init-core-data-001/]
>   [junit4]   2> 1976987 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34304518368427706]
>   [junit4]   2> 1977014 WARN  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
>   [junit4]   2> 1977070 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
>   [junit4]   2> 1977071 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>   [junit4]   2> 1977071 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
>   [junit4]   2> 1977072 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
>   [junit4]   2> 1977073 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=48.427734375, floorSegmentMB=0.83984375, forceMergeDeletesPctAllowed=8.616976919946959, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>   [junit4]   2> 1977073 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@ba57ea4[collection1] main]
>   [junit4]   2> 1977074 WARN  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
>   [junit4]   2> 1977074 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
>   [junit4]   2> 1977076 INFO  (searcherExecutor-7356-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@ba57ea4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 1977076 INFO  (coreLoadExecutor-7355-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1596276841216212992
>   [junit4]   2> 1977079 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
>   [junit4]   2> 1977082 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testVersionsOnRestart
>   [junit4]   2> 1977083 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
>   [junit4]   2> 1977085 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@a5de1ff[collection1] realtime]
>   [junit4]   2> 1977085 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 1
>   [junit4]   2> 1977085 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596276841225650176,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
>   [junit4]   2> 1977085 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6cbaf3c2 commitCommandVersion:1596276841225650176
>   [junit4]   2> 1977095 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@22275867[collection1] main]
>   [junit4]   2> 1977095 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
>   [junit4]   2> 1977096 INFO  (searcherExecutor-7356-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@22275867[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 1977096 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 11
>   [junit4]   2> 1977099 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[D1 (1596276841239281664)]} 0 1
>   [junit4]   2> 1977099 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[D2 (1596276841240330240)]} 0 0
>   [junit4]   2> 1977099 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596276841240330241,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
>   [junit4]   2> 1977099 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6cbaf3c2 commitCommandVersion:1596276841240330241
>   [junit4]   2> 1977130 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b8af8ac[collection1] main]
>   [junit4]   2> 1977130 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
>   [junit4]   2> 1977132 INFO  (searcherExecutor-7356-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2b8af8ac[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):c2)))}
>   [junit4]   2> 1977132 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 33
>   [junit4]   2> 1977133 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:D1&wt=xml} hits=1 status=0 QTime=0
>   [junit4]   2> 1977134 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:D2&wt=xml} hits=1 status=0 QTime=0
>   [junit4]   2> 1977134 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=618159072
>   [junit4]   2> 1977134 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
>   [junit4]   2> 1977134 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@79ce74b4: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3a759dd5
>   [junit4]   2> 1977138 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
>   [junit4]   2> 1977138 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7e634c9e: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7f7e01c0
>   [junit4]   2> 1977140 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
>   [junit4]   2> 1977140 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@77bcddcc: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4a9954dd
>   [junit4]   2> 1977141 INFO  (coreCloseExecutor-7361-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1ce3edb5
>   [junit4]   2> 1977141 INFO  (coreCloseExecutor-7361-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1ce3edb5
>   [junit4]   2> 1977141 INFO  (coreCloseExecutor-7361-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6b8df480: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@288cef6
>   [junit4]   2> 1977153 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
>   [junit4]   2> 1977173 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
>   [junit4]   2> 1977183 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.IndexSchema [null] Schema name=test
>   [junit4]   2> 1977255 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>   [junit4]   2> 1977303 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1977311 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1977311 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1977312 INFO  (coreLoadExecutor-7368-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
>   [junit4]   2> 1977313 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
>   [junit4]   2> 1977332 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
>   [junit4]   2> 1977339 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
>   [junit4]   2> 1977395 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>   [junit4]   2> 1977401 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
>   [junit4]   2> 1977401 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1977401 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
>   [junit4]   2> 1977401 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-001/init-core-data-001/]
>   [junit4]   2> 1977405 WARN  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
>   [junit4]   2> 1977446 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
>   [junit4]   2> 1977446 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>   [junit4]   2> 1977446 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
>   [junit4]   2> 1977447 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
>   [junit4]   2> 1977447 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34304518368427706]
>   [junit4]   2> 1977449 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b9f2dde[collection1] main]
>   [junit4]   2> 1977449 WARN  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
>   [junit4]   2> 1977450 INFO  (coreLoadExecutor-7368-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
>   [junit4]   2> 1977450 INFO  (searcherExecutor-7369-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3b9f2dde[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):c2)))}
>   [junit4]   2> 1977453 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[D1 (1596276841610477568)]} 0 1
>   [junit4]   2> 1977453 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596276841611526144,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
>   [junit4]   2> 1977453 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@39327486 commitCommandVersion:1596276841611526144
>   [junit4]   2> 1977703 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@37aee0f0[collection1] main]
>   [junit4]   2> 1977704 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
>   [junit4]   2> 1977705 INFO  (searcherExecutor-7369-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@37aee0f0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):c2/1:delGen=1) Uninverting(_1(8.0.0):c1)))}
>   [junit4]   2> 1977705 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 252
>   [junit4]   2> 1977706 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:D1&wt=xml} hits=1 status=0 QTime=0
>   [junit4]   2> 1977707 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/get&getVersions=2&wt=xml} status=0 QTime=0
>   [junit4]   2> 1977708 INFO  (TEST-TestRecovery.testVersionsOnRestart-seed#[D6674863F4F03A58]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testVersionsOnRestart
>   [junit4]   2> 1977714 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLogReplayWithReorderedDBQByAsterixAndChildDocs
>   [junit4]   2> 1977715 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
>   [junit4]   2> 1977716 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@616dca23[collection1] realtime]
>   [junit4]   2> 1977716 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
>   [junit4]   2> 1977716 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596276841887301632,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
>   [junit4]   2> 1977716 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@39327486 commitCommandVersion:1596276841887301632
>   [junit4]   2> 1977728 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6211b1fe[collection1] main]
>   [junit4]   2> 1977728 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
>   [junit4]   2> 1977730 INFO  (searcherExecutor-7369-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6211b1fe[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 1977730 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 14
>   [junit4]   2> 1977732 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[RDBQ2_1 (2)]} 0 0
>   [junit4]   2> 1977732 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[RDBQ2_2 (5)]} 0 0
>   [junit4]   2> 1977736 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@478e9c69[collection1] realtime]
>   [junit4]   2> 1977738 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@38622721[collection1] realtime]
>   [junit4]   2> 1977738 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&_version_=-4&wt=json&indent=true}{deleteByQuery=_root_:RDBQ2_1 _root_:RDBQ2_2 id:RDBQ2_3 _root_:RDBQ2_4 (-4)} 0 6
>   [junit4]   2> 1977738 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 Reordered DBQs detected.  Update=add{_version_=3,id=RDBQ2_3} DBQs=[DBQ{version=4,q=_root_:RDBQ2_1 _root_:RDBQ2_2 id:RDBQ2_3 _root_:RDBQ2_4}]
>   [junit4]   2> 1977748 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7207c1d[collection1] realtime]
>   [junit4]   2> 1977748 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[RDBQ2_3 (3)]} 0 10
>   [junit4]   2> 1977749 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={update.distrib=FROMLEADER&wt=json&indent=true}{add=[RDBQ2_4 (6)]} 0 0
>   [junit4]   2> 1977749 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=0 status=0 QTime=0
>   [junit4]   2> 1977749 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=974864582
>   [junit4]   2> 1977749 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
>   [junit4]   2> 1977749 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3a53f5d1: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@5643cb13
>   [junit4]   2> 1977755 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
>   [junit4]   2> 1977755 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@63bfd2eb: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7f7e01c0
>   [junit4]   2> 1977758 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
>   [junit4]   2> 1977758 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6c21feab: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4a9954dd
>   [junit4]   2> 1977759 INFO  (coreCloseExecutor-7374-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@47825cae
>   [junit4]   2> 1977759 INFO  (coreCloseExecutor-7374-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=47825cae
>   [junit4]   2> 1977759 INFO  (coreCloseExecutor-7374-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@42503ab8: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@5401755e
>   [junit4]   2> 1977767 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
>   [junit4]   2> 1977785 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
>   [junit4]   2> 1977793 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.IndexSchema [null] Schema name=test
>   [junit4]   2> 1977852 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>   [junit4]   2> 1977886 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1977892 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1977892 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1977893 INFO  (coreLoadExecutor-7381-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
>   [junit4]   2> 1977893 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
>   [junit4]   2> 1977918 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
>   [junit4]   2> 1977928 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
>   [junit4]   2> 1977988 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>   [junit4]   2> 1977993 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
>   [junit4]   2> 1977993 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2704d31f
>   [junit4]   2> 1977993 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
>   [junit4]   2> 1977993 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-001/init-core-data-001/]
>   [junit4]   2> 1977997 WARN  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
>   [junit4]   2> 1978030 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
>   [junit4]   2> 1978030 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>   [junit4]   2> 1978032 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
>   [junit4]   2> 1978032 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
>   [junit4]   2> 1978032 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34304518368427706]
>   [junit4]   2> 1978033 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@25eef4ab[collection1] main]
>   [junit4]   2> 1978033 WARN  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
>   [junit4]   2> 1978034 INFO  (coreLoadExecutor-7381-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
>   [junit4]   2> 1978034 INFO  (searcherExecutor-7382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@25eef4ab[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 1978035 WARN  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.UpdateLog Starting log replay tlog{file=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-001/init-core-data-001/tlog/tlog.0000000000000000004 refcount=2} active=false starting pos=0 inSortedOrder=false
>   [junit4]   2> 1978036 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=0 status=0 QTime=0
>   [junit4]   2> 1978043 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2441d6aa[collection1] realtime]
>   [junit4]   2> 1978044 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@12a0a9bc[collection1] realtime]
>   [junit4]   2> 1978044 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 Reordered DBQs detected.  Update=add{flags=a,_version_=3,id=RDBQ2_3} DBQs=[DBQ{version=4,q=_root_:RDBQ2_1 _root_:RDBQ2_2 id:RDBQ2_3 _root_:RDBQ2_4}]
>   [junit4]   2> 1978048 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@38ad88f2[collection1] realtime]
>   [junit4]   2> 1978049 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{flags=2,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
>   [junit4]   2> 1978049 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@40890820 commitCommandVersion:0
>   [junit4]   2> 1978085 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7c3cf18e[collection1] main]
>   [junit4]   2> 1978085 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
>   [junit4]   2> 1978086 INFO  (searcherExecutor-7382-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7c3cf18e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(8.0.0):c6/3:delGen=1) Uninverting(_5(8.0.0):c3)))}
>   [junit4]   2> 1978087 INFO  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[RDBQ2_1 (2), RDBQ2_2 (5), RDBQ2_3 (3), RDBQ2_4 (6)],deleteByQuery=_root_:RDBQ2_1 _root_:RDBQ2_2 id:RDBQ2_3 _root_:RDBQ2_4 (-4)} 0 51
>   [junit4]   2> 1978087 WARN  (recoveryExecutor-7384-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.UpdateLog Log replay finished. recoveryInfo=RecoveryInfo{adds=4 deletes=0 deleteByQuery=1 errors=0 positionOfStart=0}
>   [junit4]   2> 1978087 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=6 status=0 QTime=0
>   [junit4]   2> 1978087 INFO  (TEST-TestRecovery.testLogReplayWithReorderedDBQByAsterixAndChildDocs-seed#[D6674863F4F03A58]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testLogReplayWithReorderedDBQByAsterixAndChildDocs
>   [junit4]   2> 1978091 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCleanShutdown
>   [junit4]   2> 1978091 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
>   [junit4]   2> 1978092 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3bfa3698[collection1] realtime]
>   [junit4]   2> 1978092 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 0
>   [junit4]   2> 1978092 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596276842281566208,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
>   [junit4]   2> 1978092 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@40890820 commitCommandVersion:1596276842281566208
>   [junit4]   2> 1978102 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3db6a4cc[collection1] main]
>   [junit4]   2> 1978102 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
>   [junit4]   2> 1978103 INFO  (searcherExecutor-7382-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3db6a4cc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 1978104 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 11
>   [junit4]   2> 1978105 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[E1 (1596276842294149120)]} 0 1
>   [junit4]   2> 1978106 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[E2 (1596276842295197696)]} 0 0
>   [junit4]   2> 1978106 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2057475401
>   [junit4]   2> 1978106 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
>   [junit4]   2> 1978106 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@12e1b36f: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@342a679c
>   [junit4]   2> 1978111 INFO  (TEST-TestRecovery.testCleanShutdown-seed#[D6674863F4F03A58]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr
> 
> [...truncated too long message...]
> 
> overy.testReload-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6ee13cc[collection1] realtime]
>   [junit4]   2> 73261 INFO  (TEST-TestRecovery.testReload-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=foo_t:hownowbrowncow (-1596280249756155904)} 0 5
>   [junit4]   2> 73261 INFO  (TEST-TestRecovery.testReload-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[reload1 (1596280249762447360)]} 0 0
>   [junit4]   2> 73262 INFO  (TEST-TestRecovery.testReload-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testReload
>   [junit4] OK      0.21s J0 | TestRecovery.testReload
>   [junit4]   2> 73264 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Starting testBuffering
>   [junit4]   2> 73265 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
>   [junit4]   2> 73265 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@17c0e568[collection1] realtime]
>   [junit4]   2> 73266 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 1
>   [junit4]   2> 73266 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1596280249767690240,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
>   [junit4]   2> 73266 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@75d8099b commitCommandVersion:1596280249767690240
>   [junit4]   2> 73275 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3a5d0a26[collection1] main]
>   [junit4]   2> 73276 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
>   [junit4]   2> 73277 INFO  (searcherExecutor-1008-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3a5d0a26[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 73278 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 12
>   [junit4]   2> 73278 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
>   [junit4]   2> 73278 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
>   [junit4]   2> 73279 INFO  (TEST-TestRecovery.testBuffering-seed#[D6674863F4F03A58]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testBuffering
>   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestRecovery -Dtests.method=testBuffering -Dtests.seed=D6674863F4F03A58 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=lt -Dtests.timezone=Africa/Conakry -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
>   [junit4] ERROR   0.02s J0 | TestRecovery.testBuffering <<<
>   [junit4]    > Throwable #1: java.lang.NullPointerException
>   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D6674863F4F03A58:CB89E64855A99B73]:0)
>   [junit4]    > 	at org.apache.solr.search.TestRecovery.testBuffering(TestRecovery.java:495)
>   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
>   [junit4] IGNOR/A 0.01s J0 | TestRecovery.testRecoveryMultipleLogs
>   [junit4]    > Assumption #1: Ignored, failures limit reached (5 >= 5).
>   [junit4]   2> 73285 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
>   [junit4]   2> 73285 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2121935719
>   [junit4]   2> 73285 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
>   [junit4]   2> 73285 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@53ebf6a0: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3ec28f90
>   [junit4]   2> 73288 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
>   [junit4]   2> 73288 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2ab4b003: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3dbd939a
>   [junit4]   2> 73288 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
>   [junit4]   2> 73288 INFO  (SUITE-TestRecovery-seed#[D6674863F4F03A58]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3c59d44a: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@122fa483
>   [junit4]   2> 73288 INFO  (coreCloseExecutor-1012-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@568efe64
>   [junit4]   2> 73288 INFO  (coreCloseExecutor-1012-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=568efe64
>   [junit4]   2> 73288 INFO  (coreCloseExecutor-1012-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@270c41b3: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@338f2d3c
>   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_D6674863F4F03A58-003
>   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {_root_=Lucene50(blocksize=128), id=FSTOrd50}, docValues:{_version_=DocValuesFormat(name=Lucene70), val_i_dvo=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=647, maxMBSortInHeap=6.830494683367925, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@7ac28831), locale=lt, timezone=Africa/Conakry
>   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=1,free=128930056,total=314572800
>   [junit4]   2> NOTE: All tests run in this JVM: [TestRecovery, TestRecovery, TestRecovery]
>   [junit4] Completed [5/5 (5!)] on J0 in 10.46s, 19 tests, 1 error, 1 skipped <<< FAILURES!
> 
> [...truncated 18 lines...]
> BUILD FAILED
> /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1568: The following error occurred while executing this line:
> /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1092: There were test failures: 5 suites, 95 tests, 9 errors, 1 ignored (1 assumption) [seed: D6674863F4F03A58]
> 
> Total time: 1 minute 19 seconds
> 
> [repro] Setting last failure code to 256
> 
> [repro] Failures:
> [repro]   5/5 failed: org.apache.solr.search.TestRecovery
> [repro] Exiting with code 256
> + mv lucene/build lucene/build.repro
> + mv solr/build solr/build.repro
> + mv lucene/build.orig lucene/build
> + mv solr/build.orig solr/build
> Archiving artifacts
> Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
> [WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
> Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
> Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
> <Git Blamer> Using GitBlamer to create author and commit information for all warnings.
> <Git Blamer> GIT_COMMIT=668b81721fa5b539d9286ed2f464426a598c352a, workspace=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris
> [WARNINGS] Computing warning deltas based on reference build #1765
> Recording test results
> Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
> Build step 'Publish JUnit test result report' changed build result to UNSTABLE
> Email was triggered for: Unstable (Test Failures)
> Sending email for trigger: Unstable (Test Failures)
> Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
> Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
> Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
> Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org