You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/07/23 14:43:11 UTC

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1987 - Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1987/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC

7 tests failed.
FAILED:  org.apache.solr.TestDistributedGrouping.test

Error Message:
.grouped[a_i1].doclist.maxScore:1.0!=null

Stack Trace:
junit.framework.AssertionFailedError: .grouped[a_i1].doclist.maxScore:1.0!=null
	at __randomizedtesting.SeedInfo.seed([5BB2AB841E58DA4D:D3E6945EB0A4B7B5]:0)
	at junit.framework.Assert.fail(Assert.java:50)
	at org.apache.solr.BaseDistributedSearchTestCase.compareSolrResponses(BaseDistributedSearchTestCase.java:928)
	at org.apache.solr.BaseDistributedSearchTestCase.compareResponses(BaseDistributedSearchTestCase.java:955)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:613)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:589)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:568)
	at org.apache.solr.TestDistributedGrouping.test(TestDistributedGrouping.java:176)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1034)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:983)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.TestDistributedGrouping.test

Error Message:
.grouped[a_i1].doclist.maxScore:1.0!=null

Stack Trace:
junit.framework.AssertionFailedError: .grouped[a_i1].doclist.maxScore:1.0!=null
	at __randomizedtesting.SeedInfo.seed([5BB2AB841E58DA4D:D3E6945EB0A4B7B5]:0)
	at junit.framework.Assert.fail(Assert.java:50)
	at org.apache.solr.BaseDistributedSearchTestCase.compareSolrResponses(BaseDistributedSearchTestCase.java:928)
	at org.apache.solr.BaseDistributedSearchTestCase.compareResponses(BaseDistributedSearchTestCase.java:955)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:613)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:589)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:568)
	at org.apache.solr.TestDistributedGrouping.test(TestDistributedGrouping.java:176)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1034)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:983)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.TestDistributedGrouping.test

Error Message:
.grouped[a_i1].doclist.maxScore:1.0!=null

Stack Trace:
junit.framework.AssertionFailedError: .grouped[a_i1].doclist.maxScore:1.0!=null
	at __randomizedtesting.SeedInfo.seed([5BB2AB841E58DA4D:D3E6945EB0A4B7B5]:0)
	at junit.framework.Assert.fail(Assert.java:50)
	at org.apache.solr.BaseDistributedSearchTestCase.compareSolrResponses(BaseDistributedSearchTestCase.java:928)
	at org.apache.solr.BaseDistributedSearchTestCase.compareResponses(BaseDistributedSearchTestCase.java:955)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:613)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:589)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:568)
	at org.apache.solr.TestDistributedGrouping.test(TestDistributedGrouping.java:176)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1034)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:983)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.TestDistributedGrouping.test

Error Message:
.grouped[a_i1].doclist.maxScore:1.0!=null

Stack Trace:
junit.framework.AssertionFailedError: .grouped[a_i1].doclist.maxScore:1.0!=null
	at __randomizedtesting.SeedInfo.seed([5BB2AB841E58DA4D:D3E6945EB0A4B7B5]:0)
	at junit.framework.Assert.fail(Assert.java:50)
	at org.apache.solr.BaseDistributedSearchTestCase.compareSolrResponses(BaseDistributedSearchTestCase.java:928)
	at org.apache.solr.BaseDistributedSearchTestCase.compareResponses(BaseDistributedSearchTestCase.java:955)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:613)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:589)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:568)
	at org.apache.solr.TestDistributedGrouping.test(TestDistributedGrouping.java:176)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1034)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:983)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.TestDistributedGrouping.test

Error Message:
.grouped[a_i1].doclist.maxScore:1.0!=null

Stack Trace:
junit.framework.AssertionFailedError: .grouped[a_i1].doclist.maxScore:1.0!=null
	at __randomizedtesting.SeedInfo.seed([5BB2AB841E58DA4D:D3E6945EB0A4B7B5]:0)
	at junit.framework.Assert.fail(Assert.java:50)
	at org.apache.solr.BaseDistributedSearchTestCase.compareSolrResponses(BaseDistributedSearchTestCase.java:928)
	at org.apache.solr.BaseDistributedSearchTestCase.compareResponses(BaseDistributedSearchTestCase.java:955)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:613)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:589)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:568)
	at org.apache.solr.TestDistributedGrouping.test(TestDistributedGrouping.java:176)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1034)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:983)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.TestDistributedGrouping.test

Error Message:
.grouped[a_i1].doclist.maxScore:1.0!=null

Stack Trace:
junit.framework.AssertionFailedError: .grouped[a_i1].doclist.maxScore:1.0!=null
	at __randomizedtesting.SeedInfo.seed([5BB2AB841E58DA4D:D3E6945EB0A4B7B5]:0)
	at junit.framework.Assert.fail(Assert.java:50)
	at org.apache.solr.BaseDistributedSearchTestCase.compareSolrResponses(BaseDistributedSearchTestCase.java:928)
	at org.apache.solr.BaseDistributedSearchTestCase.compareResponses(BaseDistributedSearchTestCase.java:955)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:613)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:589)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:568)
	at org.apache.solr.TestDistributedGrouping.test(TestDistributedGrouping.java:176)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1034)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:983)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Error from server at http://127.0.0.1:59630/solr: Could not restore core

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:59630/solr: Could not restore core
	at __randomizedtesting.SeedInfo.seed([5BB2AB841E58DA4D:D3E6945EB0A4B7B5]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:323)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:146)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12621 lines...]
   [junit4] Suite: org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/init-core-data-001
   [junit4]   2> 518208 WARN  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=377 numCloses=377
   [junit4]   2> 518213 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 518214 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 518214 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 518419 WARN  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 518427 WARN  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 518429 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 518441 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.m.log Extract jar:file:/export/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_serv1.vm3_58159_hdfs____jswaxf/webapp
   [junit4]   2> 518914 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@serv1-vm3:58159
   [junit4]   2> 519028 WARN  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 519029 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 519043 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.m.log Extract jar:file:/export/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_43647_datanode____.11e9q7/webapp
   [junit4]   2> 519519 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43647
   [junit4]   2> 519643 WARN  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 519644 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 519658 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.m.log Extract jar:file:/export/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_50680_datanode____.nu3mue/webapp
   [junit4]   2> 519696 ERROR (DataNode: [[[DISK]file:/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to serv1-vm3/127.0.0.1:59671) [    ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
   [junit4]   2> 519707 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x1b136875c60a56: from storage DS-8963760b-a465-4409-8da4-a32744f7fcec node DatanodeRegistration(127.0.0.1:55889, datanodeUuid=dfe7511b-1c7e-4fb4-8a2b-9b64557eaa3e, infoPort=63553, infoSecurePort=0, ipcPort=63648, storageInfo=lv=-56;cid=testClusterID;nsid=1200841791;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 519707 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x1b136875c60a56: from storage DS-d5d437f3-732a-4853-9a3a-e3c4751a177f node DatanodeRegistration(127.0.0.1:55889, datanodeUuid=dfe7511b-1c7e-4fb4-8a2b-9b64557eaa3e, infoPort=63553, infoSecurePort=0, ipcPort=63648, storageInfo=lv=-56;cid=testClusterID;nsid=1200841791;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 520115 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50680
   [junit4]   2> 520223 ERROR (DataNode: [[[DISK]file:/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to serv1-vm3/127.0.0.1:59671) [    ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
   [junit4]   2> 520249 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x1b1368959fd73b: from storage DS-d5405358-333f-4605-a3c3-7aa895c600d1 node DatanodeRegistration(127.0.0.1:55522, datanodeUuid=42b79d8b-a8bd-4618-9c73-bf4fd8a9e7f7, infoPort=32878, infoSecurePort=0, ipcPort=50434, storageInfo=lv=-56;cid=testClusterID;nsid=1200841791;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
   [junit4]   2> 520249 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x1b1368959fd73b: from storage DS-ef7dba66-c92d-4735-9009-1fafe00a3c90 node DatanodeRegistration(127.0.0.1:55522, datanodeUuid=42b79d8b-a8bd-4618-9c73-bf4fd8a9e7f7, infoPort=32878, infoSecurePort=0, ipcPort=50434, storageInfo=lv=-56;cid=testClusterID;nsid=1200841791;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 520285 WARN  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.s.c.a.c.TestHdfsCloudBackupRestore The NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 525285 WARN  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.s.c.a.c.TestHdfsCloudBackupRestore The NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 530290 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002
   [junit4]   2> 530290 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 530290 INFO  (Thread-1357) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 530290 INFO  (Thread-1357) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 530292 ERROR (Thread-1357) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 530392 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:38645
   [junit4]   2> 530396 INFO  (zkConnectionManagerCallback-1512-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 530400 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 530400 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 530401 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 530401 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 530401 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3cf36254{/solr,null,AVAILABLE}
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@399bcf{HTTP/1.1,[http/1.1]}{127.0.0.1:59630}
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.Server Started @530780ms
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@46173d5c{/solr,null,AVAILABLE}
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59630}
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4e54f602{HTTP/1.1,[http/1.1]}{127.0.0.1:47183}
   [junit4]   2> 530402 ERROR (jetty-launcher-1509-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.Server Started @530780ms
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=47183}
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 530402 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 530403 ERROR (jetty-launcher-1509-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 530403 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-07-23T13:19:32.636Z
   [junit4]   2> 530403 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 530403 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 530403 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 530403 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 530403 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-07-23T13:19:32.636Z
   [junit4]   2> 530406 INFO  (zkConnectionManagerCallback-1516-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 530407 INFO  (zkConnectionManagerCallback-1514-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 530407 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 530408 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 530411 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 530411 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 530785 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38645/solr
   [junit4]   2> 530796 INFO  (zkConnectionManagerCallback-1520-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 530798 INFO  (zkConnectionManagerCallback-1522-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 530853 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38645/solr
   [junit4]   2> 530856 INFO  (zkConnectionManagerCallback-1528-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 530859 INFO  (zkConnectionManagerCallback-1530-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 530875 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59630_solr
   [junit4]   2> 530876 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.c.Overseer Overseer (id=72557055319212038-127.0.0.1:59630_solr-n_0000000000) starting
   [junit4]   2> 530890 INFO  (zkConnectionManagerCallback-1537-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 530892 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38645/solr ready
   [junit4]   2> 530908 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:47183_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47183_solr
   [junit4]   2> 530919 INFO  (zkCallback-1529-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 530919 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:47183_solr    ] o.a.s.c.b.r.BackupRepositoryFactory Added backup repository with configuration params {type = repository,name = hdfs,class = org.apache.solr.core.backup.repository.HdfsBackupRepository,attributes = {name=hdfs, class=org.apache.solr.core.backup.repository.HdfsBackupRepository},args = {location=/backup,solr.hdfs.home=hdfs://serv1-vm3:59671/solr,solr.hdfs.confdir=}}
   [junit4]   2> 530919 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:47183_solr    ] o.a.s.c.b.r.BackupRepositoryFactory Default configuration for backup repository is with configuration params {type = repository,name = hdfs,class = org.apache.solr.core.backup.repository.HdfsBackupRepository,attributes = {name=hdfs, class=org.apache.solr.core.backup.repository.HdfsBackupRepository},args = {location=/backup,solr.hdfs.home=hdfs://serv1-vm3:59671/solr,solr.hdfs.confdir=}}
   [junit4]   2> 530925 INFO  (zkCallback-1521-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 530926 INFO  (zkCallback-1536-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 530946 INFO  (OverseerStateUpdate-72557055319212038-127.0.0.1:59630_solr-n_0000000000) [    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:59630_solr
   [junit4]   2> 530949 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 530950 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59630_solr
   [junit4]   2> 530951 INFO  (zkCallback-1529-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 530952 INFO  (zkCallback-1521-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 530952 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.c.b.r.BackupRepositoryFactory Added backup repository with configuration params {type = repository,name = hdfs,class = org.apache.solr.core.backup.repository.HdfsBackupRepository,attributes = {name=hdfs, class=org.apache.solr.core.backup.repository.HdfsBackupRepository},args = {location=/backup,solr.hdfs.home=hdfs://serv1-vm3:59671/solr,solr.hdfs.confdir=}}
   [junit4]   2> 530952 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.c.b.r.BackupRepositoryFactory Default configuration for backup repository is with configuration params {type = repository,name = hdfs,class = org.apache.solr.core.backup.repository.HdfsBackupRepository,attributes = {name=hdfs, class=org.apache.solr.core.backup.repository.HdfsBackupRepository},args = {location=/backup,solr.hdfs.home=hdfs://serv1-vm3:59671/solr,solr.hdfs.confdir=}}
   [junit4]   2> 530967 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 531069 INFO  (zkCallback-1536-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 531085 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 531090 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 531090 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 531091 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:59630_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node2/.
   [junit4]   2> 531105 INFO  (zkConnectionManagerCallback-1543-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 531108 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:47183_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 531109 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:47183_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38645/solr ready
   [junit4]   2> 531111 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:47183_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 531129 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:47183_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 531138 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:47183_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 531138 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:47183_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 531139 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:47183_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node1/.
   [junit4]   2> 531163 INFO  (zkConnectionManagerCallback-1546-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 531166 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101c641e4400009, likely client has closed socket
   [junit4]   2> 531167 INFO  (zkConnectionManagerCallback-1551-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 531168 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 531169 INFO  (SUITE-TestHdfsCloudBackupRestore-seed#[5BB2AB841E58DA4D]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38645/solr ready
   [junit4]   2> 531272 INFO  (TEST-TestHdfsCloudBackupRestore.test-seed#[5BB2AB841E58DA4D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 531275 INFO  (qtp111839536-5878) [n:127.0.0.1:59630_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&version=2&pullReplicas=1&property.customKey=customValue&maxShardsPerNode=-1&router.field=shard_s&autoAddReplicas=true&name=hdfsbackuprestore&nrtReplicas=2&action=CREATE&numShards=2&tlogReplicas=0&wt=javabin and sendToOCPQueue=true
   [junit4]   2> 531278 INFO  (OverseerThreadFactory-2182-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection hdfsbackuprestore
   [junit4]   2> 531279 WARN  (OverseerThreadFactory-2182-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 3 on collection hdfsbackuprestore is higher than the number of Solr instances currently live or live and part of your createNodeSet(2). It's unusual to run two replica of the same slice on the same Solr-instance.
   [junit4]   2> 531393 INFO  (OverseerStateUpdate-72557055319212038-127.0.0.1:59630_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"hdfsbackuprestore",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"hdfsbackuprestore_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:47183/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 531400 INFO  (OverseerStateUpdate-72557055319212038-127.0.0.1:59630_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"hdfsbackuprestore",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"hdfsbackuprestore_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:59630/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 531403 INFO  (OverseerStateUpdate-72557055319212038-127.0.0.1:59630_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"hdfsbackuprestore",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"hdfsbackuprestore_shard1_replica_p4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:47183/solr",
   [junit4]   2>   "type":"PULL",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 531407 INFO  (OverseerStateUpdate-72557055319212038-127.0.0.1:59630_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"hdfsbackuprestore",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"hdfsbackuprestore_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:59630/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 531413 INFO  (OverseerStateUpdate-72557055319212038-127.0.0.1:59630_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"hdfsbackuprestore",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"hdfsbackuprestore_shard2_replica_n8",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:47183/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 531418 INFO  (OverseerStateUpdate-72557055319212038-127.0.0.1:59630_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"hdfsbackuprestore",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"hdfsbackuprestore_shard2_replica_p10",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:59630/solr",
   [junit4]   2>   "type":"PULL",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 531627 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr    x:hdfsbackuprestore_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=hdfsbackuprestore&version=2&replicaType=NRT&property.customKey=customValue&coreNodeName=core_node2&name=hdfsbackuprestore_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin
   [junit4]   2> 531628 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr    x:hdfsbackuprestore_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 531633 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr    x:hdfsbackuprestore_shard2_replica_n6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=hdfsbackuprestore&version=2&replicaType=NRT&property.customKey=customValue&coreNodeName=core_node9&name=hdfsbackuprestore_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&wt=javabin
   [junit4]   2> 531635 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr    x:hdfsbackuprestore_shard1_replica_p4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=hdfsbackuprestore&version=2&replicaType=PULL&property.customKey=customValue&coreNodeName=core_node7&name=hdfsbackuprestore_shard1_replica_p4&action=CREATE&numShards=2&shard=shard1&wt=javabin
   [junit4]   2> 531646 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr    x:hdfsbackuprestore_shard2_replica_n8] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=hdfsbackuprestore&version=2&replicaType=NRT&property.customKey=customValue&coreNodeName=core_node11&name=hdfsbackuprestore_shard2_replica_n8&action=CREATE&numShards=2&shard=shard2&wt=javabin
   [junit4]   2> 531646 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr    x:hdfsbackuprestore_shard2_replica_p10] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=hdfsbackuprestore&version=2&replicaType=PULL&property.customKey=customValue&coreNodeName=core_node12&name=hdfsbackuprestore_shard2_replica_p10&action=CREATE&numShards=2&shard=shard2&wt=javabin
   [junit4]   2> 531646 INFO  (qtp111839536-5876) [n:127.0.0.1:59630_solr    x:hdfsbackuprestore_shard1_replica_n3] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=hdfsbackuprestore&version=2&replicaType=NRT&property.customKey=customValue&coreNodeName=core_node5&name=hdfsbackuprestore_shard1_replica_n3&action=CREATE&numShards=2&shard=shard1&wt=javabin
   [junit4]   2> 532642 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 532648 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.s.IndexSchema [hdfsbackuprestore_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 532651 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 532651 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'hdfsbackuprestore_shard1_replica_n1' using configuration from collection hdfsbackuprestore, trusted=true
   [junit4]   2> 532651 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.hdfsbackuprestore.shard1.replica_n1' (registry 'solr.core.hdfsbackuprestore.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 532651 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 532651 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.c.SolrCore [[hdfsbackuprestore_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node1/hdfsbackuprestore_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node1/./hdfsbackuprestore_shard1_replica_n1/data/]
   [junit4]   2> 532660 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 532667 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.s.IndexSchema [hdfsbackuprestore_shard1_replica_p4] Schema name=minimal
   [junit4]   2> 532669 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 532669 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 532669 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.c.CoreContainer Creating SolrCore 'hdfsbackuprestore_shard1_replica_p4' using configuration from collection hdfsbackuprestore, trusted=true
   [junit4]   2> 532670 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.hdfsbackuprestore.shard1.replica_p4' (registry 'solr.core.hdfsbackuprestore.shard1.replica_p4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 532670 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 532670 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.c.SolrCore [[hdfsbackuprestore_shard1_replica_p4] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node1/hdfsbackuprestore_shard1_replica_p4], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node1/./hdfsbackuprestore_shard1_replica_p4/data/]
   [junit4]   2> 532674 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node9 x:hdfsbackuprestore_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 532684 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.s.IndexSchema [hdfsbackuprestore_shard2_replica_n8] Schema name=minimal
   [junit4]   2> 532686 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 532686 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.c.CoreContainer Creating SolrCore 'hdfsbackuprestore_shard2_replica_n8' using configuration from collection hdfsbackuprestore, trusted=true
   [junit4]   2> 532686 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.hdfsbackuprestore.shard2.replica_n8' (registry 'solr.core.hdfsbackuprestore.shard2.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 532686 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 532686 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.c.SolrCore [[hdfsbackuprestore_shard2_replica_n8] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node1/hdfsbackuprestore_shard2_replica_n8], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node1/./hdfsbackuprestore_shard2_replica_n8/data/]
   [junit4]   2> 532696 INFO  (qtp111839536-5876) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard1 r:core_node5 x:hdfsbackuprestore_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 532702 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 532704 INFO  (qtp111839536-5876) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard1 r:core_node5 x:hdfsbackuprestore_shard1_replica_n3] o.a.s.s.IndexSchema [hdfsbackuprestore_shard1_replica_n3] Schema name=minimal
   [junit4]   2> 532710 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node9 x:hdfsbackuprestore_shard2_replica_n6] o.a.s.s.IndexSchema [hdfsbackuprestore_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 532712 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node9 x:hdfsbackuprestore_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 532712 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node9 x:hdfsbackuprestore_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'hdfsbackuprestore_shard2_replica_n6' using configuration from collection hdfsbackuprestore, trusted=true
   [junit4]   2> 532713 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node9 x:hdfsbackuprestore_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.hdfsbackuprestore.shard2.replica_n6' (registry 'solr.core.hdfsbackuprestore.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 532713 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node9 x:hdfsbackuprestore_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 532713 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node9 x:hdfsbackuprestore_shard2_replica_n6] o.a.s.c.SolrCore [[hdfsbackuprestore_shard2_replica_n6] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node2/hdfsbackuprestore_shard2_replica_n6], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node2/./hdfsbackuprestore_shard2_replica_n6/data/]
   [junit4]   2> 532722 INFO  (qtp111839536-5876) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard1 r:core_node5 x:hdfsbackuprestore_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 532722 INFO  (qtp111839536-5876) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard1 r:core_node5 x:hdfsbackuprestore_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'hdfsbackuprestore_shard1_replica_n3' using configuration from collection hdfsbackuprestore, trusted=true
   [junit4]   2> 532722 INFO  (qtp111839536-5876) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard1 r:core_node5 x:hdfsbackuprestore_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.hdfsbackuprestore.shard1.replica_n3' (registry 'solr.core.hdfsbackuprestore.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 532722 INFO  (qtp111839536-5876) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard1 r:core_node5 x:hdfsbackuprestore_shard1_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 532722 INFO  (qtp111839536-5876) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard1 r:core_node5 x:hdfsbackuprestore_shard1_replica_n3] o.a.s.c.SolrCore [[hdfsbackuprestore_shard1_replica_n3] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node2/hdfsbackuprestore_shard1_replica_n3], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node2/./hdfsbackuprestore_shard1_replica_n3/data/]
   [junit4]   2> 532754 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.s.IndexSchema [hdfsbackuprestore_shard2_replica_p10] Schema name=minimal
   [junit4]   2> 532756 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 532756 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.c.CoreContainer Creating SolrCore 'hdfsbackuprestore_shard2_replica_p10' using configuration from collection hdfsbackuprestore, trusted=true
   [junit4]   2> 532756 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.hdfsbackuprestore.shard2.replica_p10' (registry 'solr.core.hdfsbackuprestore.shard2.replica_p10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36da70f8
   [junit4]   2> 532757 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 532757 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.c.SolrCore [[hdfsbackuprestore_shard2_replica_p10] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node2/hdfsbackuprestore_shard2_replica_p10], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_5BB2AB841E58DA4D-001/tempDir-002/node2/./hdfsbackuprestore_shard2_replica_p10/data/]
   [junit4]   2> 532761 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 532761 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 532763 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.s.SolrIndexSearcher Opening [Searcher@29c3db90[hdfsbackuprestore_shard1_replica_p4] main]
   [junit4]   2> 532790 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 532799 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 532800 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 532801 INFO  (searcherExecutor-2192-thread-1-processing-n:127.0.0.1:47183_solr x:hdfsbackuprestore_shard1_replica_p4 c:hdfsbackuprestore s:shard1 r:core_node7) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.c.SolrCore [hdfsbackuprestore_shard1_replica_p4] Registered new searcher Searcher@29c3db90[hdfsbackuprestore_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 532818 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 532818 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 532818 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.c.ZkController hdfsbackuprestore_shard1_replica_p4 starting background replication from leader
   [junit4]   2> 532818 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 532819 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 532819 INFO  (qtp1393092708-5886) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node7 x:hdfsbackuprestore_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 532820 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 532820 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 532824 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6ef42023[hdfsbackuprestore_shard1_replica_n1] main]
   [junit4]   2> 532829 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 532831 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 532835 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 532835 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606787504608903168
   [junit4]   2> 532844 INFO  (searcherExecutor-2191-thread-1-processing-n:127.0.0.1:47183_solr x:hdfsbackuprestore_shard1_replica_n1 c:hdfsbackuprestore s:shard1 r:core_node2) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.c.SolrCore [hdfsbackuprestore_shard1_replica_n1] Registered new searcher Searcher@6ef42023[hdfsbackuprestore_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 532860 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 532860 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 532862 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.s.SolrIndexSearcher Opening [Searcher@61ce7dab[hdfsbackuprestore_shard2_replica_p10] main]
   [junit4]   2> 532871 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 532871 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 532873 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 532873 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 532874 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node9 x:hdfsbackuprestore_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 532874 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node9 x:hdfsbackuprestore_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 532875 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.s.SolrIndexSearcher Opening [Searcher@7f6371f0[hdfsbackuprestore_shard2_replica_n8] main]
   [junit4]   2> 532877 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 532877 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node9 x:hdfsbackuprestore_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 532877 INFO  (qtp111839536-5872) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node9 x:hdfsbackuprestore_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 532878 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 532878 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 532879 INFO  (searcherExecutor-2197-thread-1-processing-n:127.0.0.1:59630_solr x:hdfsbackuprestore_shard2_replica_p10 c:hdfsbackuprestore s:shard2 r:core_node12) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.c.SolrCore [hdfsbackuprestore_shard2_replica_p10] Registered new searcher Searcher@61ce7dab[hdfsbackuprestore_shard2_replica_p10] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 532880 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 532882 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.c.ZkController hdfsbackuprestore_shard2_replica_p10 starting background replication from leader
   [junit4]   2> 532882 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 532883 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 532883 INFO  (qtp111839536-5877) [n:127.0.0.1:59630_solr c:hdfsbackuprestore s:shard2 r:core_node12 x:hdfsbackuprestore_shard2_replica_p10] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 532885 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/hdfsbackuprestore/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 532890 INFO  (qtp1393092708-5885) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard1 r:core_node2 x:hdfsbackuprestore_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 532890 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 532891 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 532891 INFO  (qtp1393092708-5883) [n:127.0.0.1:47183_solr c:hdfsbackuprestore s:shard2 r:core_node11 x:hdfsbackuprestore_shard2_replica_n8] o.a.s.u.UpdateLog Could not find ma

[...truncated too long message...]

icManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 110586 INFO  (TEST-TestDistributedGrouping.test-seed#[5BB2AB841E58DA4D]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@37990279: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@4d76ba9b
   [junit4]   2> 110602 INFO  (TEST-TestDistributedGrouping.test-seed#[5BB2AB841E58DA4D]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 110602 INFO  (TEST-TestDistributedGrouping.test-seed#[5BB2AB841E58DA4D]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@27bac78: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@20fd5dc3
   [junit4]   2> 110606 INFO  (TEST-TestDistributedGrouping.test-seed#[5BB2AB841E58DA4D]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 110606 INFO  (TEST-TestDistributedGrouping.test-seed#[5BB2AB841E58DA4D]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2be4b84f: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2a8e5a30
   [junit4]   2> 110611 INFO  (coreCloseExecutor-298-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@62b787e2
   [junit4]   2> 110611 INFO  (coreCloseExecutor-298-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=62b787e2
   [junit4]   2> 110611 INFO  (coreCloseExecutor-298-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@48a6ea18: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@79fe96fd
   [junit4]   2> 110638 INFO  (TEST-TestDistributedGrouping.test-seed#[5BB2AB841E58DA4D]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3eb8f413{/,null,UNAVAILABLE}
   [junit4]   2> 110639 INFO  (TEST-TestDistributedGrouping.test-seed#[5BB2AB841E58DA4D]) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDistributedGrouping -Dtests.method=test -Dtests.seed=5BB2AB841E58DA4D -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=en-MT -Dtests.timezone=Europe/Rome -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 5.89s J1 | TestDistributedGrouping.test <<<
   [junit4]    > Throwable #1: junit.framework.AssertionFailedError: .grouped[a_i1].doclist.maxScore:1.0!=null
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([5BB2AB841E58DA4D:D3E6945EB0A4B7B5]:0)
   [junit4]    > 	at junit.framework.Assert.fail(Assert.java:50)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.compareSolrResponses(BaseDistributedSearchTestCase.java:928)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.compareResponses(BaseDistributedSearchTestCase.java:955)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:613)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:589)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:568)
   [junit4]    > 	at org.apache.solr.TestDistributedGrouping.test(TestDistributedGrouping.java:176)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1034)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:983)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_5BB2AB841E58DA4D-005
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {other_tl1=PostingsFormat(name=LuceneVarGapFixedInterval), SubjectTerms_mfacet=PostingsFormat(name=LuceneVarGapFixedInterval), range_facet_l_dv=PostingsFormat(name=Direct), n_l1=PostingsFormat(name=Asserting), a_n_tdt=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), multiDefault=PostingsFormat(name=Asserting), intDefault=PostingsFormat(name=LuceneVarGapFixedInterval), n_td1=PostingsFormat(name=LuceneVarGapFixedInterval), n_d1=PostingsFormat(name=Asserting), n_f1=PostingsFormat(name=LuceneVarGapFixedInterval), range_facet_l=PostingsFormat(name=Asserting), n_tl1=PostingsFormat(name=LuceneVarGapFixedInterval), a_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), n_tf1=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=Asserting), id=PostingsFormat(name=Direct), text=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), oddField_s1=PostingsFormat(name=LuceneVarGapFixedInterval), a_idv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), timestamp=PostingsFormat(name=Asserting), n_dt1=PostingsFormat(name=LuceneVarGapFixedInterval), a_i1=PostingsFormat(name=Asserting), b_n_tdt=PostingsFormat(name=LuceneVarGapFixedInterval), n_ti1=PostingsFormat(name=Direct), rnd_b=PostingsFormat(name=Direct), foo_b=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), n_tdt1=PostingsFormat(name=LuceneVarGapFixedInterval), foo_d=PostingsFormat(name=Direct), id_i1=PostingsFormat(name=LuceneVarGapFixedInterval), range_facet_i_dv=PostingsFormat(name=Asserting), foo_f=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Lucene70), intDvoDefault=DocValuesFormat(name=Lucene70), a_idv=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=1107, maxMBSortInHeap=7.842191056294308, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@fad923c), locale=en-MT, timezone=Europe/Rome
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=3,threads=1,free=141294248,total=264241152
   [junit4]   2> NOTE: All tests run in this JVM: [TestDistributedGrouping, TestDistributedGrouping, TestDistributedGrouping, TestDistributedGrouping, TestHdfsCloudBackupRestore, TestHdfsCloudBackupRestore, TestDistributedGrouping]
   [junit4] Completed [9/10 (5!)] on J1 in 5.93s, 1 test, 1 failure <<< FAILURES!
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore
   [junit4] OK      10.9s J0 | TestHdfsCloudBackupRestore.test
   [junit4] Completed [10/10 (5!)] on J0 in 34.50s, 1 test
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 5BB2AB841E58DA4D]:
   [junit4]   - org.apache.solr.TestDistributedGrouping.test
   [junit4]   - org.apache.solr.TestDistributedGrouping.test
   [junit4]   - org.apache.solr.TestDistributedGrouping.test
   [junit4]   - org.apache.solr.TestDistributedGrouping.test
   [junit4]   - org.apache.solr.TestDistributedGrouping.test
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.71 ..   121.89 =   121.18s
   [junit4] JVM J1:     0.71 ..   111.42 =   110.71s
   [junit4] Execution time total: 2 minutes 1 second
   [junit4] Tests summary: 10 suites, 10 tests, 5 failures

BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1568: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1092: There were test failures: 10 suites, 10 tests, 5 failures [seed: 5BB2AB841E58DA4D]

Total time: 2 minutes 3 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore
[repro]   5/5 failed: org.apache.solr.TestDistributedGrouping
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=028c86b1fa70faeec4f7705698a59557f58bcbb0, workspace=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris
[WARNINGS] Computing warning deltas based on reference build #1986
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1992 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1992/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild

Error Message:
junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException

Stack Trace:
java.util.concurrent.ExecutionException: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at __randomizedtesting.SeedInfo.seed([A49517DE469233B8:7B18756178FB66DA]:0)
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild(InfixSuggestersTest.java:130)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2734)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more
Caused by: java.lang.RuntimeException: Exception during query
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2726)
	... 6 more
Caused by: org.apache.solr.common.SolrException: SolrCoreState already closed.
	at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
	at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1812)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
	... 9 more


FAILED:  org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild

Error Message:
junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException

Stack Trace:
java.util.concurrent.ExecutionException: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at __randomizedtesting.SeedInfo.seed([A49517DE469233B8:7B18756178FB66DA]:0)
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild(InfixSuggestersTest.java:130)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2734)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more
Caused by: java.lang.RuntimeException: Exception during query
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2726)
	... 6 more
Caused by: org.apache.solr.common.SolrException: SolrCoreState already closed.
	at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
	at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1812)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
	... 9 more


FAILED:  org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild

Error Message:
junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException

Stack Trace:
java.util.concurrent.ExecutionException: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at __randomizedtesting.SeedInfo.seed([A49517DE469233B8:7B18756178FB66DA]:0)
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild(InfixSuggestersTest.java:130)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2734)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more
Caused by: java.lang.RuntimeException: Exception during query
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2726)
	... 6 more
Caused by: org.apache.solr.common.SolrException: SolrCoreState already closed.
	at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
	at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1812)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
	... 9 more




Build Log:
[...truncated 12290 lines...]
   [junit4] Suite: org.apache.solr.handler.component.InfixSuggestersTest
   [junit4]   2> 199491 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A49517DE469233B8-001/init-core-data-001
   [junit4]   2> 199492 WARN  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=10 numCloses=10
   [junit4]   2> 199492 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 199494 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 199495 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 199495 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 199526 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 199543 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 199697 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 201507 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 201508 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 201529 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 201537 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 201537 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 201539 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 201575 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 201612 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 201860 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 201881 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 201882 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 201889 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 201891 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A49517DE469233B8-001/init-core-data-001/]
   [junit4]   2> 201893 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=47.28515625, floorSegmentMB=1.6923828125, forceMergeDeletesPctAllowed=1.4502548586792807, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2058108265526345, deletesPctAllowed=45.61548082001043
   [junit4]   2> 202073 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 202073 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 202074 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3379395110061194]
   [junit4]   2> 202087 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@41f2597f[collection1] main]
   [junit4]   2> 202087 WARN  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 202088 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 202095 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 202148 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 202148 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 202148 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 202148 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 202148 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 202148 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 202172 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 202172 INFO  (coreLoadExecutor-514-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 202173 INFO  (searcherExecutor-515-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@41f2597f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 202175 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 202178 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBuildThen2xReload
   [junit4]   2> 202178 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
   [junit4]   2> 202178 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.s.s.SolrSuggester SolrSuggester.build(shortRandomAnalyzingInfixSuggester)
   [junit4]   2> 202242 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.shortRandomAnalyzingInfixSuggester disabled after emitting 100 items.
   [junit4]   2> 202352 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.h.c.SuggestComponent SuggestComponent process with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
   [junit4]   2> 202352 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/suggest_analyzing_infix_short_dictionary&suggest.buildAll=true&wt=xml} status=0 QTime=174
   [junit4]   2> 202356 ERROR (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/core.properties
   [junit4]   2> 202357 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 202405 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 202419 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 202594 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 202618 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    ] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1
   [junit4]   2> 202640 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 202641 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A49517DE469233B8-001/init-core-data-001/]
   [junit4]   2> 202700 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 202700 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 202702 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@74ee953a[collection1] main]
   [junit4]   2> 202705 WARN  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 202705 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 202705 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 202706 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 202706 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 202706 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 202706 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 202706 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 202706 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 202706 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 202706 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 202706 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=48, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 202712 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 202714 INFO  (searcherExecutor-519-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@74ee953a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 202714 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@40eb8939[collection1] main]
   [junit4]   2> 202715 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@fce7f7e
   [junit4]   2> 202715 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=fce7f7e
   [junit4]   2> 202715 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@59f70a8f: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@4de854d
   [junit4]   2> 202725 INFO  (searcherExecutor-519-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@40eb8939[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 202727 ERROR (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/core.properties
   [junit4]   2> 202728 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 202756 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 202772 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 202931 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 202947 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1
   [junit4]   2> 202970 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 202970 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A49517DE469233B8-001/init-core-data-001/]
   [junit4]   2> 203037 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 203037 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 203038 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@35d54618[collection1] main]
   [junit4]   2> 203039 WARN  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 203041 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 203041 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 203050 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 203051 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 203051 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 203051 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 203051 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 203051 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 203051 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 203051 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 203054 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24479644737480444]
   [junit4]   2> 203058 INFO  (searcherExecutor-523-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@35d54618[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 203059 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 203059 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@66bc76a8[collection1] main]
   [junit4]   2> 203059 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5498d106
   [junit4]   2> 203060 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=5498d106
   [junit4]   2> 203060 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@53e6484c: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@4de854d
   [junit4]   2> 203098 INFO  (searcherExecutor-523-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@66bc76a8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 203106 INFO  (TEST-InfixSuggestersTest.testBuildThen2xReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testBuildThen2xReload
   [junit4]   2> 203110 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Starting testShutdownDuringBuild
   [junit4]   2> 203112 INFO  (AnalyzingInfixSuggesterTest-190-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : qt=/suggest_analyzing_infix_long_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
   [junit4]   2> 203112 INFO  (AnalyzingInfixSuggesterTest-190-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(longRandomAnalyzingInfixSuggester)
   [junit4]   2> 203221 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1738361937
   [junit4]   2> 203222 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 203222 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4cf6c918: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@69d93858
   [junit4]   2> 203226 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 203226 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@558ec6c1: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2f40a8c8
   [junit4]   2> 203228 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 203228 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3b54214f: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@491e2dd
   [junit4]   2> 203237 INFO  (coreCloseExecutor-527-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@46b85216
   [junit4]   2> 203238 INFO  (coreCloseExecutor-527-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=46b85216
   [junit4]   2> 203238 INFO  (coreCloseExecutor-527-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@71d2873b: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@4de854d
   [junit4]   2> 203283 INFO  (AnalyzingInfixSuggesterTest-190-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.longRandomAnalyzingInfixSuggester emitted 1000 items.
   [junit4]   2> 203737 ERROR (AnalyzingInfixSuggesterTest-190-thread-1-processing-x:collection1) [    x:collection1] o.a.s.SolrTestCaseJ4 REQUEST FAILED: qt=/suggest_analyzing_infix_long_dictionary&suggest.buildAll=true&wt=xml:org.apache.solr.common.SolrException: SolrCoreState already closed.
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
   [junit4]   2> 	at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1812)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
   [junit4]   2> 	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
   [junit4]   2> 	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
   [junit4]   2> 	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
   [junit4]   2> 	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2726)
   [junit4]   2> 	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 203738 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 203739 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 203756 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 203855 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 203939 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 204933 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 204933 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 204955 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 204960 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 204960 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 204962 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 205124 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 205135 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 205329 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 205419 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 205419 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 205419 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 205419 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A49517DE469233B8-001/init-core-data-001/]
   [junit4]   2> 205481 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 205481 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 205482 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=47.28515625, floorSegmentMB=1.6923828125, forceMergeDeletesPctAllowed=1.4502548586792807, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2058108265526345, deletesPctAllowed=45.61548082001043
   [junit4]   2> 205483 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@27bbf4d8[collection1] main]
   [junit4]   2> 205483 WARN  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 205483 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 205483 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 205486 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 205486 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 205486 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 205489 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 205489 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 205489 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 205489 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 205489 INFO  (coreLoadExecutor-537-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 205490 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 205491 INFO  (TEST-InfixSuggestersTest.testShutdownDuringBuild-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testShutdownDuringBuild
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=InfixSuggestersTest -Dtests.method=testShutdownDuringBuild -Dtests.seed=A49517DE469233B8 -Dtests.slow=true -Dtests.locale=und -Dtests.timezone=SystemV/HST10 -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   2.39s J1 | InfixSuggestersTest.testShutdownDuringBuild <<<
   [junit4]    > Throwable #1: java.util.concurrent.ExecutionException: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([A49517DE469233B8:7B18756178FB66DA]:0)
   [junit4]    > 	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
   [junit4]    > 	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
   [junit4]    > 	at org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild(InfixSuggestersTest.java:130)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
   [junit4]    > 	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2734)
   [junit4]    > 	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
   [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]    > 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    > 	... 1 more
   [junit4]    > Caused by: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
   [junit4]    > 	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
   [junit4]    > 	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2726)
   [junit4]    > 	... 6 more
   [junit4]    > Caused by: org.apache.solr.common.SolrException: SolrCoreState already closed.
   [junit4]    > 	at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
   [junit4]    > 	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
   [junit4]    > 	at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1812)
   [junit4]    > 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
   [junit4]    > 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
   [junit4]    > 	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
   [junit4]    > 	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
   [junit4]    > 	... 9 more
   [junit4]   2> 205496 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Starting test2xBuildReload
   [junit4]   2> 205496 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
   [junit4]   2> 205496 INFO  (searcherExecutor-538-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@27bbf4d8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 205496 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(shortRandomAnalyzingInfixSuggester)
   [junit4]   2> 205512 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.shortRandomAnalyzingInfixSuggester disabled after emitting 100 items.
   [junit4]   2> 205619 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
   [junit4]   2> 205619 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/suggest_analyzing_infix_short_dictionary&suggest.buildAll=true&wt=xml} status=0 QTime=123
   [junit4]   2> 205619 ERROR (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/core.properties
   [junit4]   2> 205620 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 205649 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 205663 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 205865 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 205875 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1
   [junit4]   2> 205897 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 205897 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A49517DE469233B8-001/init-core-data-001/]
   [junit4]   2> 205946 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 205946 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 205948 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@60f63621[collection1] main]
   [junit4]   2> 205949 WARN  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 205949 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 205949 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 205952 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 205952 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 205952 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 205954 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 205954 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 205954 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 205955 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 205955 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 205955 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=22.0849609375, floorSegmentMB=1.5205078125, forceMergeDeletesPctAllowed=15.701641899426726, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=26.125422124061483
   [junit4]   2> 205956 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 205957 INFO  (searcherExecutor-542-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@60f63621[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 205957 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@35a0444[collection1] main]
   [junit4]   2> 206019 INFO  (searcherExecutor-542-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@35a0444[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 206020 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@15381a87
   [junit4]   2> 206020 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=15381a87
   [junit4]   2> 206020 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@28f069f3: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@614e1362
   [junit4]   2> 206029 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
   [junit4]   2> 206029 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(shortRandomAnalyzingInfixSuggester)
   [junit4]   2> 206037 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.shortRandomAnalyzingInfixSuggester disabled after emitting 100 items.
   [junit4]   2> 206069 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
   [junit4]   2> 206070 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/suggest_analyzing_infix_short_dictionary&suggest.buildAll=true&wt=xml} status=0 QTime=40
   [junit4]   2> 206070 ERROR (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/core.properties:java.nio.file.NoSuchFileException: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/core.properties
   [junit4]   2> 206070 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 206097 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 206235 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 206323 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 206347 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1
   [junit4]   2> 206365 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5baaf2c9
   [junit4]   2> 206365 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.handler.component.InfixSuggestersTest_A49517DE469233B8-001/init-core-data-001/]
   [junit4]   2> 206430 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 206431 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 206432 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@301fc0e4[collection1] main]
   [junit4]   2> 206432 WARN  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 206432 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 206432 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 206435 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,indexPath=short_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 206435 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 206435 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 206437 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=longRandomAnalyzingInfixSuggester,lookupImpl=AnalyzingInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100000,indexPath=long_random_analyzing_infix_suggester,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false}
   [junit4]   2> 206437 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
   [junit4]   2> 206437 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 206437 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 206437 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 206438 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=4.2880859375, floorSegmentMB=0.3310546875, forceMergeDeletesPctAllowed=19.520768766434834, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=27.51582537297878
   [junit4]   2> 206439 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 206439 INFO  (searcherExecutor-546-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@301fc0e4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 206439 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@416a062c[collection1] main]
   [junit4]   2> 206439 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3e5a3226
   [junit4]   2> 206439 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=3e5a3226
   [junit4]   2> 206439 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@793df168: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@614e1362
   [junit4]   2> 206439 INFO  (searcherExecutor-546-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@416a062c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 206449 INFO  (TEST-InfixSuggestersTest.test2xBuildReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending test2xBuildReload
   [junit4]   2> 206452 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Starting testAnalyzingInfixSuggesterBuildThenReload
   [junit4]   2> 206452 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
   [junit4]   2> 206452 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(shortRandomAnalyzingInfixSuggester)
   [junit4]   2> 206462 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.RandomTestDictionaryFactory org.apache.solr.spelling.suggest.RandomTestDictionaryFactory$RandomTestDictionary.enabled.shortRandomAnalyzingInfixSuggester disabled after emitting 100 items.
   [junit4]   2> 206514 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : qt=/suggest_analyzing_infix_short_dictionary&suggest=true&suggest.buildAll=true&wt=xml&indent=off
   [junit4]   2> 206514 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=null path=null params={qt=/suggest_analyzing_infix_short_dictionary&suggest.buildAll=true&wt=xml} status=0 QTime=62
   [junit4]   2> 206528 ERROR (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/

[...truncated too long message...]

olrSuggester init: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 50667 INFO  (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 50667 INFO  (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 50668 INFO  (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=84.697265625, floorSegmentMB=0.3994140625, forceMergeDeletesPctAllowed=24.12014741444684, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=33.47198192724143
   [junit4]   2> 50670 INFO  (searcherExecutor-193-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3886e3bc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 50670 INFO  (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 50671 INFO  (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2ad6eb0b[collection1] main]
   [junit4]   2> 50672 INFO  (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@cb5ee05
   [junit4]   2> 50672 INFO  (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=cb5ee05
   [junit4]   2> 50672 INFO  (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5b48abdf: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@6d49511b
   [junit4]   2> 50673 INFO  (searcherExecutor-193-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2ad6eb0b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 50687 INFO  (TEST-InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload-seed#[A49517DE469233B8]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testBlendedInfixSuggesterBuildThenReload
   [junit4] OK      0.66s J0 | InfixSuggestersTest.testBlendedInfixSuggesterBuildThenReload
   [junit4]   2> 50687 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 50688 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1585278977
   [junit4]   2> 50688 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 50688 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3c0fbe6f: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@12d31e13
   [junit4]   2> 50693 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 50693 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@25109e2e: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@6a63088a
   [junit4]   2> 50693 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 50693 INFO  (SUITE-InfixSuggestersTest-seed#[A49517DE469233B8]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7791a574: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@31a584ba
   [junit4]   2> 50704 INFO  (coreCloseExecutor-197-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@63a6f794
   [junit4]   2> 50709 INFO  (coreCloseExecutor-197-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=63a6f794
   [junit4]   2> 50709 INFO  (coreCloseExecutor-197-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@368fbf69: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@6d49511b
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.InfixSuggestersTest_A49517DE469233B8-002
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {textgrams=PostingsFormat(name=Asserting), text=PostingsFormat(name=LuceneVarGapDocFreqInterval), exacttext=Lucene50(blocksize=128)}, docValues:{weight=DocValuesFormat(name=Direct), text=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=453, maxMBSortInHeap=5.3967905995723795, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@42854696), locale=und, timezone=SystemV/HST10
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=3,threads=1,free=53427680,total=99278848
   [junit4]   2> NOTE: All tests run in this JVM: [InfixSuggestersTest, InfixSuggestersTest, InfixSuggestersTest]
   [junit4] Completed [5/5 (3!)] on J0 in 8.62s, 7 tests, 1 error <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: A49517DE469233B8]:
   [junit4]   - org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild
   [junit4]   - org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild
   [junit4]   - org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     1.08 ..    51.39 =    50.31s
   [junit4] JVM J1:     1.07 ..    45.24 =    44.17s
   [junit4] Execution time total: 51 seconds
   [junit4] Tests summary: 5 suites, 35 tests, 3 errors

BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1568: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1092: There were test failures: 5 suites, 35 tests, 3 errors [seed: A49517DE469233B8]

Total time: 54 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   3/5 failed: org.apache.solr.handler.component.InfixSuggestersTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=71c0bddd149b7c0364fbba8d31494dcd9f57f1ef, workspace=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris
[WARNINGS] Computing warning deltas based on reference build #1991
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1991 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1991/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC

7 tests failed.
FAILED:  org.apache.solr.cloud.api.collections.TestCollectionAPI.test

Error Message:
Aliases should not be null

Stack Trace:
java.lang.AssertionError: Aliases should not be null
	at __randomizedtesting.SeedInfo.seed([999DE8AE4B8C97AF:11C9D774E570FA57]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.api.collections.TestCollectionAPI.clusterStatusAliasTest(TestCollectionAPI.java:440)
	at org.apache.solr.cloud.api.collections.TestCollectionAPI.test(TestCollectionAPI.java:88)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1008)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:983)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestReplicationHandler.testRateLimitedReplication

Error Message:
expected:<99> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<99> but was:<0>
	at __randomizedtesting.SeedInfo.seed([999DE8AE4B8C97AF:1F099D5B443E1642]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.handler.TestReplicationHandler.testRateLimitedReplication(TestReplicationHandler.java:1455)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild

Error Message:
junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException

Stack Trace:
java.util.concurrent.ExecutionException: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at __randomizedtesting.SeedInfo.seed([999DE8AE4B8C97AF:46108A1175E5C2CD]:0)
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild(InfixSuggestersTest.java:130)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2734)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more
Caused by: java.lang.RuntimeException: Exception during query
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2726)
	... 6 more
Caused by: org.apache.solr.common.SolrException: SolrCoreState already closed.
	at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
	at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1812)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
	... 9 more


FAILED:  org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild

Error Message:
junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException

Stack Trace:
java.util.concurrent.ExecutionException: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at __randomizedtesting.SeedInfo.seed([999DE8AE4B8C97AF:46108A1175E5C2CD]:0)
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild(InfixSuggestersTest.java:130)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2734)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more
Caused by: java.lang.RuntimeException: Exception during query
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2726)
	... 6 more
Caused by: org.apache.solr.common.SolrException: SolrCoreState already closed.
	at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
	at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1812)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
	... 9 more


FAILED:  org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild

Error Message:
junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException

Stack Trace:
java.util.concurrent.ExecutionException: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at __randomizedtesting.SeedInfo.seed([999DE8AE4B8C97AF:46108A1175E5C2CD]:0)
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild(InfixSuggestersTest.java:130)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2734)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more
Caused by: java.lang.RuntimeException: Exception during query
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2726)
	... 6 more
Caused by: org.apache.solr.common.SolrException: SolrCoreState already closed.
	at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
	at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1812)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
	... 9 more


FAILED:  org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild

Error Message:
junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException

Stack Trace:
java.util.concurrent.ExecutionException: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at __randomizedtesting.SeedInfo.seed([999DE8AE4B8C97AF:46108A1175E5C2CD]:0)
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild(InfixSuggestersTest.java:130)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2734)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more
Caused by: java.lang.RuntimeException: Exception during query
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2726)
	... 6 more
Caused by: org.apache.solr.common.SolrException: SolrCoreState already closed.
	at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
	at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1812)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
	... 9 more


FAILED:  org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild

Error Message:
junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException

Stack Trace:
java.util.concurrent.ExecutionException: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at __randomizedtesting.SeedInfo.seed([999DE8AE4B8C97AF:46108A1175E5C2CD]:0)
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild(InfixSuggestersTest.java:130)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: junit.framework.AssertionFailedError: Unexpected wrapped exception type, expected CoreIsClosedException
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2734)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$testShutdownDuringBuild$3(InfixSuggestersTest.java:121)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more
Caused by: java.lang.RuntimeException: Exception during query
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
	at org.apache.solr.handler.component.InfixSuggestersTest.lambda$null$2(InfixSuggestersTest.java:122)
	at org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2726)
	... 6 more
Caused by: org.apache.solr.common.SolrException: SolrCoreState already closed.
	at org.apache.solr.update.DefaultSolrCoreState.lock(DefaultSolrCoreState.java:186)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:121)
	at org.apache.solr.update.SolrCoreState.getTragicException(SolrCoreState.java:198)
	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:1812)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:212)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:337)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:319)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:891)
	... 9 more




Build Log:
[...truncated 12501 lines...]
   [junit4] Suite: org.apache.solr.cloud.api.collections.TestCollectionAPI
   [junit4]   2> 648030 INFO  (SUITE-TestCollectionAPI-seed#[999DE8AE4B8C97AF]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/init-core-data-001
   [junit4]   2> 648030 WARN  (SUITE-TestCollectionAPI-seed#[999DE8AE4B8C97AF]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=29 numCloses=29
   [junit4]   2> 648030 INFO  (SUITE-TestCollectionAPI-seed#[999DE8AE4B8C97AF]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 648031 INFO  (SUITE-TestCollectionAPI-seed#[999DE8AE4B8C97AF]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 648032 INFO  (SUITE-TestCollectionAPI-seed#[999DE8AE4B8C97AF]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 648039 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 648039 INFO  (Thread-1116) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 648039 INFO  (Thread-1116) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 648046 ERROR (Thread-1116) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 648140 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.ZkTestServer start zk server on port:47002
   [junit4]   2> 648148 INFO  (zkConnectionManagerCallback-2918-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 648159 INFO  (zkConnectionManagerCallback-2920-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 648167 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 648170 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 648172 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 648173 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 648175 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 648177 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 648178 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 648180 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 648181 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 648183 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 648185 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 648187 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 648319 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 648320 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 648320 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 648320 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 648323 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6793f627{/,null,AVAILABLE}
   [junit4]   2> 648323 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@31ce89ac{HTTP/1.1,[http/1.1]}{127.0.0.1:50862}
   [junit4]   2> 648323 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.Server Started @648717ms
   [junit4]   2> 648325 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/tempDir-001/control/data, hostContext=/, hostPort=50862, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/control-001/cores}
   [junit4]   2> 648325 ERROR (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 648325 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 648325 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 648326 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 648326 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 648326 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-07-25T11:10:04.239Z
   [junit4]   2> 648327 INFO  (zkConnectionManagerCallback-2922-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 648329 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 648329 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/control-001/solr.xml
   [junit4]   2> 648332 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 648332 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 648332 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@e055e61, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 649852 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:47002/solr
   [junit4]   2> 649853 INFO  (zkConnectionManagerCallback-2926-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 649856 INFO  (zkConnectionManagerCallback-2928-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 649983 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:50862_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50862_
   [junit4]   2> 649985 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:50862_    ] o.a.s.c.Overseer Overseer (id=72567876244733956-127.0.0.1:50862_-n_0000000000) starting
   [junit4]   2> 649995 INFO  (zkConnectionManagerCallback-2935-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 649998 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:50862_    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:47002/solr ready
   [junit4]   2> 649999 INFO  (OverseerStateUpdate-72567876244733956-127.0.0.1:50862_-n_0000000000) [    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:50862_
   [junit4]   2> 650000 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:50862_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50862_
   [junit4]   2> 650003 INFO  (zkCallback-2934-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 650005 INFO  (OverseerStateUpdate-72567876244733956-127.0.0.1:50862_-n_0000000000) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 650021 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:50862_    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 650033 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:50862_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e055e61
   [junit4]   2> 650038 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:50862_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e055e61
   [junit4]   2> 650038 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:50862_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e055e61
   [junit4]   2> 650040 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:50862_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/control-001/cores
   [junit4]   2> 650063 INFO  (zkConnectionManagerCallback-2941-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 650065 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 650067 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:47002/solr ready
   [junit4]   2> 650069 INFO  (qtp1051593176-8665) [n:127.0.0.1:50862_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:50862_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 650074 INFO  (OverseerThreadFactory-2075-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 650197 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_    x:control_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 650198 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_    x:control_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 651220 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 651228 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 651273 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 651295 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 651295 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e055e61
   [junit4]   2> 651295 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 651296 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 651297 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=34, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 651298 WARN  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 651336 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 651336 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 651337 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 651337 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 651337 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=96.32421875, floorSegmentMB=0.50390625, forceMergeDeletesPctAllowed=6.811215406529469, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18147884270680603, deletesPctAllowed=27.996269461722562
   [junit4]   2> 651338 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@70397332[control_collection_shard1_replica_n1] main]
   [junit4]   2> 651339 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 651340 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 651340 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 651341 INFO  (searcherExecutor-2080-thread-1-processing-n:127.0.0.1:50862_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@70397332[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 651341 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606960553398370304
   [junit4]   2> 651348 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 651353 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 651353 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 651353 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:50862/control_collection_shard1_replica_n1/
   [junit4]   2> 651354 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 651354 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:50862/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 651354 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 651359 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:50862/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 651463 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 651468 INFO  (qtp1051593176-8661) [n:127.0.0.1:50862_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1278
   [junit4]   2> 651471 INFO  (qtp1051593176-8665) [n:127.0.0.1:50862_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 651566 INFO  (zkCallback-2927-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 652075 INFO  (OverseerCollectionConfigSetProcessor-72567876244733956-127.0.0.1:50862_-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 652472 INFO  (qtp1051593176-8665) [n:127.0.0.1:50862_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:50862_&wt=javabin&version=2} status=0 QTime=2404
   [junit4]   2> 652472 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101d01955ac0006, likely client has closed socket
   [junit4]   2> 652478 INFO  (zkConnectionManagerCallback-2946-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 652479 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 652481 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:47002/solr ready
   [junit4]   2> 652481 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 652482 INFO  (qtp1051593176-8667) [n:127.0.0.1:50862_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 652486 INFO  (OverseerThreadFactory-2075-thread-2) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 652487 WARN  (OverseerThreadFactory-2075-thread-2) [    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 652693 INFO  (qtp1051593176-8667) [n:127.0.0.1:50862_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 652693 INFO  (qtp1051593176-8667) [n:127.0.0.1:50862_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=210
   [junit4]   2> 652815 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/shard-1-001 of type NRT
   [junit4]   2> 652816 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 652817 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 652817 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 652817 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 652817 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@57608198{/,null,AVAILABLE}
   [junit4]   2> 652818 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2527320a{HTTP/1.1,[http/1.1]}{127.0.0.1:33123}
   [junit4]   2> 652818 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.Server Started @653214ms
   [junit4]   2> 652818 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=33123, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/shard-1-001/cores}
   [junit4]   2> 652818 ERROR (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 652820 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 652820 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 652820 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 652820 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 652820 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-07-25T11:10:08.733Z
   [junit4]   2> 652822 INFO  (zkConnectionManagerCallback-2948-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 652823 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 652823 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/shard-1-001/solr.xml
   [junit4]   2> 652835 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 652835 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 652836 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@e055e61, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 653213 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:47002/solr
   [junit4]   2> 653215 INFO  (zkConnectionManagerCallback-2952-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 653218 INFO  (zkConnectionManagerCallback-2954-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 653229 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:33123_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 653236 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:33123_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 653236 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:33123_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33123_
   [junit4]   2> 653238 INFO  (zkCallback-2945-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 653238 INFO  (zkCallback-2927-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 653238 INFO  (zkCallback-2934-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 653238 INFO  (zkCallback-2953-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 653258 INFO  (zkConnectionManagerCallback-2961-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 653260 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:33123_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 653263 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:33123_    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:47002/solr ready
   [junit4]   2> 653263 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:33123_    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 653276 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:33123_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e055e61
   [junit4]   2> 653282 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:33123_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e055e61
   [junit4]   2> 653283 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:33123_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e055e61
   [junit4]   2> 653284 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:33123_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/shard-1-001/cores
   [junit4]   2> 653302 INFO  (qtp1290601028-8721) [n:127.0.0.1:33123_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:33123_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 653306 INFO  (OverseerCollectionConfigSetProcessor-72567876244733956-127.0.0.1:50862_-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 653306 INFO  (OverseerThreadFactory-2075-thread-3) [ c:collection1 s:shard2  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:33123_ for creating new replica
   [junit4]   2> 653315 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_    x:collection1_shard2_replica_n41] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 654352 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 654365 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
   [junit4]   2> 654445 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 654470 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
   [junit4]   2> 654470 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e055e61
   [junit4]   2> 654470 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 654470 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
   [junit4]   2> 654472 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=34, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 654473 WARN  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 654527 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 654527 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 654528 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 654528 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 654529 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=96.32421875, floorSegmentMB=0.50390625, forceMergeDeletesPctAllowed=6.811215406529469, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18147884270680603, deletesPctAllowed=27.996269461722562
   [junit4]   2> 654529 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@48a44766[collection1_shard2_replica_n41] main]
   [junit4]   2> 654531 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 654532 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 654532 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 654533 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606960556745424896
   [junit4]   2> 654533 INFO  (searcherExecutor-2094-thread-1-processing-n:127.0.0.1:33123_ x:collection1_shard2_replica_n41 c:collection1 s:shard2) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@48a44766[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 654540 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node42=0}, version=0}
   [junit4]   2> 654545 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 654545 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 654545 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33123/collection1_shard2_replica_n41/
   [junit4]   2> 654545 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 654545 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:33123/collection1_shard2_replica_n41/ has no replicas
   [junit4]   2> 654545 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 654550 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33123/collection1_shard2_replica_n41/ shard2
   [junit4]   2> 654703 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 654709 INFO  (qtp1290601028-8717) [n:127.0.0.1:33123_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1399
   [junit4]   2> 654712 INFO  (qtp1290601028-8721) [n:127.0.0.1:33123_ c:collection1   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:33123_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1410
   [junit4]   2> 654887 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/shard-2-001 of type NRT
   [junit4]   2> 654888 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 654889 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 654889 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 654889 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 654889 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@24611cc1{/,null,AVAILABLE}
   [junit4]   2> 654890 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3754361c{HTTP/1.1,[http/1.1]}{127.0.0.1:44978}
   [junit4]   2> 654890 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.e.j.s.Server Started @655287ms
   [junit4]   2> 654890 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=44978, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/shard-2-001/cores}
   [junit4]   2> 654893 ERROR (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 654895 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 654895 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 654895 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 654895 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 654895 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-07-25T11:10:10.808Z
   [junit4]   2> 654898 INFO  (zkConnectionManagerCallback-2964-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 654899 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 654899 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionAPI_999DE8AE4B8C97AF-001/shard-2-001/solr.xml
   [junit4]   2> 654902 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 654902 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 654902 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@e055e61, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 655178 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:47002/solr
   [junit4]   2> 655179 INFO  (zkConnectionManagerCallback-2968-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 655182 INFO  (zkConnectionManagerCallback-2970-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 655191 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:44978_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 655197 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:44978_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 655197 INFO  (TEST-TestCollectionAPI.test-seed#[999DE8AE4B8C97AF]) [n:127.0.0.1:44978_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44978_
   [junit4]   2> 655199 INFO  (zkCallback-2934-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   

[...truncated too long message...]

   [junit4]   2> 368705 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[999DE8AE4B8C97AF]) [    x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=shortRandomBlendedInfixSuggester,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=RandomTestDictionaryFactory,randDictMaxItems=100,blenderType=position_linear,suggestAnalyzerFieldType=text,indexPath=short_random_blended_infix_suggester,highlight=true,buildOnStartup=false,buildOnCommit=false}
   [junit4]   2> 368705 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[999DE8AE4B8C97AF]) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 368705 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[999DE8AE4B8C97AF]) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=40.6923828125, floorSegmentMB=1.314453125, forceMergeDeletesPctAllowed=16.30924957511399, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=27.671499521054038
   [junit4]   2> 368706 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[999DE8AE4B8C97AF]) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 368706 INFO  (searcherExecutor-3039-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@11c775e9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 368707 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[999DE8AE4B8C97AF]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@20ff5d9[collection1] main]
   [junit4]   2> 368707 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[999DE8AE4B8C97AF]) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@464172d0
   [junit4]   2> 368707 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[999DE8AE4B8C97AF]) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=464172d0
   [junit4]   2> 368707 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[999DE8AE4B8C97AF]) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6314dd: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@e9cab12
   [junit4]   2> 368708 INFO  (searcherExecutor-3039-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@20ff5d9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 368714 INFO  (TEST-InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload-seed#[999DE8AE4B8C97AF]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testAnalyzingInfixSuggesterBuildThenReload
   [junit4] OK      0.26s J0 | InfixSuggestersTest.testAnalyzingInfixSuggesterBuildThenReload
   [junit4]   2> 368715 INFO  (SUITE-InfixSuggestersTest-seed#[999DE8AE4B8C97AF]-worker) [    x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 368715 INFO  (SUITE-InfixSuggestersTest-seed#[999DE8AE4B8C97AF]-worker) [    x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1603866403
   [junit4]   2> 368715 INFO  (SUITE-InfixSuggestersTest-seed#[999DE8AE4B8C97AF]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 368715 INFO  (SUITE-InfixSuggestersTest-seed#[999DE8AE4B8C97AF]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@60cb0872: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@45af22a7
   [junit4]   2> 368718 INFO  (SUITE-InfixSuggestersTest-seed#[999DE8AE4B8C97AF]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 368718 INFO  (SUITE-InfixSuggestersTest-seed#[999DE8AE4B8C97AF]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@554f94c7: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@164f0cd7
   [junit4]   2> 368719 INFO  (SUITE-InfixSuggestersTest-seed#[999DE8AE4B8C97AF]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 368720 INFO  (SUITE-InfixSuggestersTest-seed#[999DE8AE4B8C97AF]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ba1a5d0: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@11ef35ff
   [junit4]   2> 368720 INFO  (coreCloseExecutor-3043-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@b7d3449
   [junit4]   2> 368720 INFO  (coreCloseExecutor-3043-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=b7d3449
   [junit4]   2> 368720 INFO  (coreCloseExecutor-3043-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@735d0628: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@e9cab12
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.InfixSuggestersTest_999DE8AE4B8C97AF-002
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@15673f2a), locale=ja, timezone=Pacific/Bougainville
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=3,threads=1,free=157087368,total=281018368
   [junit4]   2> NOTE: All tests run in this JVM: [TestReplicationHandler, TestReplicationHandler, TestReplicationHandler, TestCollectionAPI, InfixSuggestersTest, InfixSuggestersTest, InfixSuggestersTest]
   [junit4] Completed [14/15 (4!)] on J0 in 4.95s, 7 tests, 1 error <<< FAILURES!
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.api.collections.TestCollectionAPI
   [junit4] OK      34.7s J1 | TestCollectionAPI.test
   [junit4] Completed [15/15 (4!)] on J1 in 34.90s, 1 test
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 999DE8AE4B8C97AF]:
   [junit4]   - org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild
   [junit4]   - org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild
   [junit4]   - org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild
   [junit4]   - org.apache.solr.handler.component.InfixSuggestersTest.testShutdownDuringBuild
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.69 ..   369.42 =   368.73s
   [junit4] JVM J1:     0.71 ..   369.87 =   369.16s
   [junit4] Execution time total: 6 minutes 9 seconds
   [junit4] Tests summary: 15 suites, 120 tests, 4 errors

BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1568: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1092: There were test failures: 15 suites, 120 tests, 4 errors [seed: 999DE8AE4B8C97AF]

Total time: 6 minutes 11 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.api.collections.TestCollectionAPI
[repro]   0/5 failed: org.apache.solr.handler.TestReplicationHandler
[repro]   4/5 failed: org.apache.solr.handler.component.InfixSuggestersTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=d25f62634b95e49df739a5a2612f9b719ef3a77d, workspace=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris
[WARNINGS] Computing warning deltas based on reference build #1990
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1990 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1990/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir

Error Message:
Captured an uncaught exception in thread: Thread[id=35337, name=cdcr-replicator-12577-thread-1, state=RUNNABLE, group=TGRP-CdcrBidirectionalTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=35337, name=cdcr-replicator-12577-thread-1, state=RUNNABLE, group=TGRP-CdcrBidirectionalTest]
Caused by: java.lang.AssertionError: 1606920819828588544 != 1606920819349389312
	at __randomizedtesting.SeedInfo.seed([39F83CE73F1F8D77]:0)
	at org.apache.solr.update.CdcrUpdateLog$CdcrLogReader.forwardSeek(CdcrUpdateLog.java:611)
	at org.apache.solr.handler.CdcrReplicator.run(CdcrReplicator.java:125)
	at org.apache.solr.handler.CdcrReplicatorScheduler.lambda$null$0(CdcrReplicatorScheduler.java:81)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14047 lines...]
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
   [junit4]   2> 3119578 INFO  (SUITE-CdcrBidirectionalTest-seed#[39F83CE73F1F8D77]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/init-core-data-001
   [junit4]   2> 3119579 INFO  (SUITE-CdcrBidirectionalTest-seed#[39F83CE73F1F8D77]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 3119579 INFO  (SUITE-CdcrBidirectionalTest-seed#[39F83CE73F1F8D77]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 3119586 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBiDir
   [junit4]   2> 3119586 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster2-001
   [junit4]   2> 3119587 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 3119587 INFO  (Thread-6096) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3119587 INFO  (Thread-6096) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 3119590 ERROR (Thread-6096) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3119689 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.ZkTestServer start zk server on port:58037
   [junit4]   2> 3119694 INFO  (zkConnectionManagerCallback-10666-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3119702 INFO  (jetty-launcher-10663-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 3119703 INFO  (jetty-launcher-10663-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3119703 INFO  (jetty-launcher-10663-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3119703 INFO  (jetty-launcher-10663-thread-1) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 3119703 INFO  (jetty-launcher-10663-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@67d8ede2{/solr,null,AVAILABLE}
   [junit4]   2> 3119706 INFO  (jetty-launcher-10663-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@476b1de0{HTTP/1.1,[http/1.1]}{127.0.0.1:60814}
   [junit4]   2> 3119706 INFO  (jetty-launcher-10663-thread-1) [    ] o.e.j.s.Server Started @3121399ms
   [junit4]   2> 3119706 INFO  (jetty-launcher-10663-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60814}
   [junit4]   2> 3119706 ERROR (jetty-launcher-10663-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3119706 INFO  (jetty-launcher-10663-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 3119706 INFO  (jetty-launcher-10663-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 3119706 INFO  (jetty-launcher-10663-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3119706 INFO  (jetty-launcher-10663-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3119707 INFO  (jetty-launcher-10663-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-07-25T00:38:17.314Z
   [junit4]   2> 3119708 INFO  (zkConnectionManagerCallback-10668-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3119709 INFO  (jetty-launcher-10663-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3120226 INFO  (jetty-launcher-10663-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58037/solr
   [junit4]   2> 3120228 INFO  (zkConnectionManagerCallback-10672-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120231 INFO  (zkConnectionManagerCallback-10674-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120355 INFO  (jetty-launcher-10663-thread-1) [n:127.0.0.1:60814_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60814_solr
   [junit4]   2> 3120356 INFO  (jetty-launcher-10663-thread-1) [n:127.0.0.1:60814_solr    ] o.a.s.c.Overseer Overseer (id=72565390741143555-127.0.0.1:60814_solr-n_0000000000) starting
   [junit4]   2> 3120365 INFO  (zkConnectionManagerCallback-10681-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120368 INFO  (jetty-launcher-10663-thread-1) [n:127.0.0.1:60814_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58037/solr ready
   [junit4]   2> 3120369 INFO  (OverseerStateUpdate-72565390741143555-127.0.0.1:60814_solr-n_0000000000) [    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:60814_solr
   [junit4]   2> 3120369 INFO  (jetty-launcher-10663-thread-1) [n:127.0.0.1:60814_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60814_solr
   [junit4]   2> 3120371 INFO  (zkCallback-10680-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3120371 INFO  (OverseerStateUpdate-72565390741143555-127.0.0.1:60814_solr-n_0000000000) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3120392 INFO  (jetty-launcher-10663-thread-1) [n:127.0.0.1:60814_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 3120412 INFO  (jetty-launcher-10663-thread-1) [n:127.0.0.1:60814_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60814.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@77c0bca3
   [junit4]   2> 3120417 INFO  (jetty-launcher-10663-thread-1) [n:127.0.0.1:60814_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60814.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@77c0bca3
   [junit4]   2> 3120417 INFO  (jetty-launcher-10663-thread-1) [n:127.0.0.1:60814_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60814.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@77c0bca3
   [junit4]   2> 3120418 INFO  (jetty-launcher-10663-thread-1) [n:127.0.0.1:60814_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster2-001/node1/.
   [junit4]   2> 3120431 INFO  (zkConnectionManagerCallback-10684-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120435 INFO  (zkConnectionManagerCallback-10687-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120437 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster1-001
   [junit4]   2> 3120437 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 3120438 INFO  (Thread-6106) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3120438 INFO  (Thread-6106) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 3120441 ERROR (Thread-6106) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3120538 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.ZkTestServer start zk server on port:35757
   [junit4]   2> 3120544 INFO  (zkConnectionManagerCallback-10691-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120551 INFO  (jetty-launcher-10688-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 3120552 INFO  (jetty-launcher-10688-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3120552 INFO  (jetty-launcher-10688-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3120552 INFO  (jetty-launcher-10688-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 3120552 INFO  (jetty-launcher-10688-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5535c21{/solr,null,AVAILABLE}
   [junit4]   2> 3120553 INFO  (jetty-launcher-10688-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3dc28c24{HTTP/1.1,[http/1.1]}{127.0.0.1:55684}
   [junit4]   2> 3120553 INFO  (jetty-launcher-10688-thread-1) [    ] o.e.j.s.Server Started @3122246ms
   [junit4]   2> 3120553 INFO  (jetty-launcher-10688-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=55684}
   [junit4]   2> 3120553 ERROR (jetty-launcher-10688-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3120555 INFO  (jetty-launcher-10688-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 3120555 INFO  (jetty-launcher-10688-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 3120555 INFO  (jetty-launcher-10688-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3120555 INFO  (jetty-launcher-10688-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3120555 INFO  (jetty-launcher-10688-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-07-25T00:38:18.163Z
   [junit4]   2> 3120557 INFO  (zkConnectionManagerCallback-10693-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120558 INFO  (jetty-launcher-10688-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3120675 INFO  (jetty-launcher-10688-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35757/solr
   [junit4]   2> 3120677 INFO  (zkConnectionManagerCallback-10697-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120681 INFO  (zkConnectionManagerCallback-10699-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120818 INFO  (jetty-launcher-10688-thread-1) [n:127.0.0.1:55684_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55684_solr
   [junit4]   2> 3120819 INFO  (jetty-launcher-10688-thread-1) [n:127.0.0.1:55684_solr    ] o.a.s.c.Overseer Overseer (id=72565390796914691-127.0.0.1:55684_solr-n_0000000000) starting
   [junit4]   2> 3120830 INFO  (zkConnectionManagerCallback-10706-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120833 INFO  (jetty-launcher-10688-thread-1) [n:127.0.0.1:55684_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35757/solr ready
   [junit4]   2> 3120834 INFO  (OverseerStateUpdate-72565390796914691-127.0.0.1:55684_solr-n_0000000000) [    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:55684_solr
   [junit4]   2> 3120834 INFO  (jetty-launcher-10688-thread-1) [n:127.0.0.1:55684_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55684_solr
   [junit4]   2> 3120837 INFO  (OverseerStateUpdate-72565390796914691-127.0.0.1:55684_solr-n_0000000000) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3120837 INFO  (zkCallback-10705-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3120860 INFO  (jetty-launcher-10688-thread-1) [n:127.0.0.1:55684_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 3120885 INFO  (jetty-launcher-10688-thread-1) [n:127.0.0.1:55684_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_55684.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@77c0bca3
   [junit4]   2> 3120891 INFO  (jetty-launcher-10688-thread-1) [n:127.0.0.1:55684_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_55684.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@77c0bca3
   [junit4]   2> 3120891 INFO  (jetty-launcher-10688-thread-1) [n:127.0.0.1:55684_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_55684.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@77c0bca3
   [junit4]   2> 3120891 INFO  (jetty-launcher-10688-thread-1) [n:127.0.0.1:55684_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster1-001/node1/.
   [junit4]   2> 3120908 INFO  (zkConnectionManagerCallback-10709-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120912 INFO  (zkConnectionManagerCallback-10712-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120914 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.c.CdcrBidirectionalTest cluster2 zkHost = 127.0.0.1:58037/solr
   [junit4]   2> 3120914 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.c.CdcrBidirectionalTest cluster1 zkHost = 127.0.0.1:35757/solr
   [junit4]   2> 3120916 INFO  (zkConnectionManagerCallback-10714-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120922 INFO  (zkConnectionManagerCallback-10718-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3120924 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3120925 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35757/solr ready
   [junit4]   2> 3120927 INFO  (qtp1752523801-35206) [n:127.0.0.1:55684_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=cdcr-cluster1&maxShardsPerNode=2&name=cdcr-cluster1&nrtReplicas=1&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3120931 INFO  (OverseerThreadFactory-12538-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection cdcr-cluster1
   [junit4]   2> 3121043 INFO  (OverseerStateUpdate-72565390796914691-127.0.0.1:55684_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"cdcr-cluster1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"cdcr-cluster1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:55684/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 3121047 INFO  (OverseerStateUpdate-72565390796914691-127.0.0.1:55684_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"cdcr-cluster1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"cdcr-cluster1_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:55684/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 3121254 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr    x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-cluster1&newCollection=true&collection=cdcr-cluster1&version=2&replicaType=NRT&coreNodeName=core_node3&name=cdcr-cluster1_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 3121262 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr    x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-cluster1&newCollection=true&collection=cdcr-cluster1&version=2&replicaType=NRT&coreNodeName=core_node4&name=cdcr-cluster1_shard2_replica_n2&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 3121262 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr    x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 3122279 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 3122279 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 3122287 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.IndexSchema [cdcr-cluster1_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 3122287 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.IndexSchema [cdcr-cluster1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 3122288 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 3122288 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 3122288 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-cluster1_shard2_replica_n2' using configuration from collection cdcr-cluster1, trusted=true
   [junit4]   2> 3122288 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-cluster1_shard1_replica_n1' using configuration from collection cdcr-cluster1, trusted=true
   [junit4]   2> 3122289 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_55684.solr.core.cdcr-cluster1.shard2.replica_n2' (registry 'solr.core.cdcr-cluster1.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@77c0bca3
   [junit4]   2> 3122289 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_55684.solr.core.cdcr-cluster1.shard1.replica_n1' (registry 'solr.core.cdcr-cluster1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@77c0bca3
   [junit4]   2> 3122289 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 3122289 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 3122289 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SolrCore [[cdcr-cluster1_shard2_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster1-001/node1/cdcr-cluster1_shard2_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster1-001/node1/./cdcr-cluster1_shard2_replica_n2/data/]
   [junit4]   2> 3122289 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SolrCore [[cdcr-cluster1_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster1-001/node1/cdcr-cluster1_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster1-001/node1/./cdcr-cluster1_shard1_replica_n1/data/]
   [junit4]   2> 3122407 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 3122407 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 3122407 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 3122407 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 3122409 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 3122409 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 3122409 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 3122409 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 3122411 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@d605e79[cdcr-cluster1_shard1_replica_n1] main]
   [junit4]   2> 3122411 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@5dc8bdea[cdcr-cluster1_shard2_replica_n2] main]
   [junit4]   2> 3122412 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-cluster1
   [junit4]   2> 3122412 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-cluster1
   [junit4]   2> 3122413 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-cluster1
   [junit4]   2> 3122413 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-cluster1
   [junit4]   2> 3122413 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-cluster1/managed-schema
   [junit4]   2> 3122413 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-cluster1/managed-schema
   [junit4]   2> 3122414 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 3122414 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 3122414 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 3122414 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 3122417 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrBufferStateManager Created znode /collections/cdcr-cluster1/cdcr/state/buffer
   [junit4]   2> 3122419 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrProcessStateManager Created znode /collections/cdcr-cluster1/cdcr/state/process
   [junit4]   2> 3122421 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606920804792008704
   [junit4]   2> 3122421 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606920804792008704
   [junit4]   2> 3122421 INFO  (searcherExecutor-12544-thread-1-processing-n:127.0.0.1:55684_solr x:cdcr-cluster1_shard1_replica_n1 c:cdcr-cluster1 s:shard1 r:core_node3) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-cluster1_shard1_replica_n1] Registered new searcher Searcher@d605e79[cdcr-cluster1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3122423 INFO  (searcherExecutor-12543-thread-1-processing-n:127.0.0.1:55684_solr x:cdcr-cluster1_shard2_replica_n2 c:cdcr-cluster1 s:shard2 r:core_node4) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SolrCore [cdcr-cluster1_shard2_replica_n2] Registered new searcher Searcher@5dc8bdea[cdcr-cluster1_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3122428 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster1/terms/shard2 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 3122431 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster1/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 3122435 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 3122435 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 3122435 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55684/solr/cdcr-cluster1_shard2_replica_n2/
   [junit4]   2> 3122435 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 3122435 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SyncStrategy http://127.0.0.1:55684/solr/cdcr-cluster1_shard2_replica_n2/ has no replicas
   [junit4]   2> 3122435 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 3122437 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 3122437 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 3122437 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55684/solr/cdcr-cluster1_shard1_replica_n1/
   [junit4]   2> 3122438 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 3122439 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:55684/solr/cdcr-cluster1_shard1_replica_n1/ has no replicas
   [junit4]   2> 3122439 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 3122439 INFO  (zkCallback-10698-thread-1) [    ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-cluster1:shard2
   [junit4]   2> 3122447 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55684/solr/cdcr-cluster1_shard2_replica_n2/ shard2
   [junit4]   2> 3122447 INFO  (zkCallback-10698-thread-1) [    ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-cluster1:shard1
   [junit4]   2> 3122454 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55684/solr/cdcr-cluster1_shard1_replica_n1/ shard1
   [junit4]   2> 3122608 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 3122608 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 3122610 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=cdcr-cluster1&newCollection=true&collection=cdcr-cluster1&version=2&replicaType=NRT&coreNodeName=core_node3&name=cdcr-cluster1_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=1359
   [junit4]   2> 3122610 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=cdcr-cluster1&newCollection=true&collection=cdcr-cluster1&version=2&replicaType=NRT&coreNodeName=core_node4&name=cdcr-cluster1_shard2_replica_n2&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=1357
   [junit4]   2> 3122615 INFO  (qtp1752523801-35206) [n:127.0.0.1:55684_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 3122713 INFO  (zkCallback-10698-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-cluster1/state.json] for collection [cdcr-cluster1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3122935 INFO  (OverseerCollectionConfigSetProcessor-72565390796914691-127.0.0.1:55684_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 3123620 INFO  (qtp1752523801-35206) [n:127.0.0.1:55684_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=cdcr-cluster1&maxShardsPerNode=2&name=cdcr-cluster1&nrtReplicas=1&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2} status=0 QTime=2694
   [junit4]   2> 3123622 INFO  (zkConnectionManagerCallback-10722-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3123629 INFO  (zkConnectionManagerCallback-10726-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3123631 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3123632 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58037/solr ready
   [junit4]   2> 3123633 INFO  (qtp417541079-35152) [n:127.0.0.1:60814_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=cdcr-cluster2&maxShardsPerNode=2&name=cdcr-cluster2&nrtReplicas=1&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3123637 INFO  (OverseerThreadFactory-12525-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection cdcr-cluster2
   [junit4]   2> 3123756 INFO  (OverseerStateUpdate-72565390741143555-127.0.0.1:60814_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"cdcr-cluster2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"cdcr-cluster2_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:60814/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 3123759 INFO  (OverseerStateUpdate-72565390741143555-127.0.0.1:60814_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"cdcr-cluster2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"cdcr-cluster2_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:60814/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 3123967 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr    x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-cluster2&newCollection=true&collection=cdcr-cluster2&version=2&replicaType=NRT&coreNodeName=core_node4&name=cdcr-cluster2_shard2_replica_n2&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 3123972 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr    x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 3123972 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr    x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-cluster2&newCollection=true&collection=cdcr-cluster2&version=2&replicaType=NRT&coreNodeName=core_node3&name=cdcr-cluster2_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 3124990 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 3124990 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 3124997 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.IndexSchema [cdcr-cluster2_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 3124997 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.IndexSchema [cdcr-cluster2_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 3124999 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 3124999 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 3124999 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-cluster2_shard1_replica_n1' using configuration from collection cdcr-cluster2, trusted=true
   [junit4]   2> 3124999 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-cluster2_shard2_replica_n2' using configuration from collection cdcr-cluster2, trusted=true
   [junit4]   2> 3125000 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60814.solr.core.cdcr-cluster2.shard2.replica_n2' (registry 'solr.core.cdcr-cluster2.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@77c0bca3
   [junit4]   2> 3125000 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60814.solr.core.cdcr-cluster2.shard1.replica_n1' (registry 'solr.core.cdcr-cluster2.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@77c0bca3
   [junit4]   2> 3125000 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 3125000 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 3125000 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SolrCore [[cdcr-cluster2_shard2_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster2-001/node1/cdcr-cluster2_shard2_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster2-001/node1/./cdcr-cluster2_shard2_replica_n2/data/]
   [junit4]   2> 3125000 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SolrCore [[cdcr-cluster2_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster2-001/node1/cdcr-cluster2_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBidirectionalTest_39F83CE73F1F8D77-001/cdcr-cluster2-001/node1/./cdcr-cluster2_shard1_replica_n1/data/]
   [junit4]   2> 3125064 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 3125064 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 3125064 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 3125064 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 3125066 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 3125066 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 3125066 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 3125066 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 3125068 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2eefc2c4[cdcr-cluster2_shard1_replica_n1] main]
   [junit4]   2> 3125068 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@5351a282[cdcr-cluster2_shard2_replica_n2] main]
   [junit4]   2> 3125070 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-cluster2
   [junit4]   2> 3125070 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-cluster2
   [junit4]   2> 3125070 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-cluster2
   [junit4]   2> 3125070 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-cluster2
   [junit4]   2> 3125070 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-cluster2/managed-schema
   [junit4]   2> 3125070 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-cluster2/managed-schema
   [junit4]   2> 3125071 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 3125071 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 3125072 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 3125072 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 3125076 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.CdcrBufferStateManager Created znode /collections/cdcr-cluster2/cdcr/state/buffer
   [junit4]   2> 3125077 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.CdcrProcessStateManager Created znode /collections/cdcr-cluster2/cdcr/state/process
   [junit4]   2> 3125080 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606920807580172288
   [junit4]   2> 3125080 INFO  (searcherExecutor-12556-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SolrCore [cdcr-cluster2_shard2_replica_n2] Registered new searcher Searcher@5351a282[cdcr-cluster2_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3125080 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606920807580172288
   [junit4]   2> 3125081 INFO  (searcherExecutor-12555-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-cluster2_shard1_replica_n1] Registered new searcher Searcher@2eefc2c4[cdcr-cluster2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3125086 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster2/terms/shard2 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 3125089 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster2/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 3125094 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 3125094 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 3125094 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60814/solr/cdcr-cluster2_shard2_replica_n2/
   [junit4]   2> 3125094 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 3125094 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SyncStrategy http://127.0.0.1:60814/solr/cdcr-cluster2_shard2_replica_n2/ has no replicas
   [junit4]   2> 3125095 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 3125095 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 3125095 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 3125095 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60814/solr/cdcr-cluster2_shard1_replica_n1/
   [junit4]   2> 3125096 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 3125097 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:60814/solr/cdcr-cluster2_shard1_replica_n1/ has no replicas
   [junit4]   2> 3125097 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 3125098 INFO  (zkCallback-10673-thread-1) [    ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-cluster2:shard2
   [junit4]   2> 3125105 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60814/solr/cdcr-cluster2_shard2_replica_n2/ shard2
   [junit4]   2> 3125105 INFO  (zkCallback-10673-thread-1) [    ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-cluster2:shard1
   [junit4]   2> 3125113 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60814/solr/cdcr-cluster2_shard1_replica_n1/ shard1
   [junit4]   2> 3125218 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 3125221 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=cdcr-cluster2&newCollection=true&collection=cdcr-cluster2&version=2&replicaType=NRT&coreNodeName=core_node3&name=cdcr-cluster2_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=1257
   [junit4]   2> 3125259 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 3125261 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=cdcr-cluster2&newCollection=true&collection=cdcr-cluster2&version=2&replicaType=NRT&coreNodeName=core_node4&name=cdcr-cluster2_shard2_replica_n2&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=1299
   [junit4]   2> 3125267 INFO  (qtp417541079-35152) [n:127.0.0.1:60814_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 3125365 INFO  (zkCallback-10673-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-cluster2/state.json] for collection [cdcr-cluster2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3125643 INFO  (OverseerCollectionConfigSetProcessor-72565390741143555-127.0.0.1:60814_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 3126268 INFO  (qtp417541079-35152) [n:127.0.0.1:60814_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=cdcr-cluster2&maxShardsPerNode=2&name=cdcr-cluster2&nrtReplicas=1&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2} status=0 QTime=2635
   [junit4]   2> 3126274 INFO  (zkConnectionManagerCallback-10733-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3126277 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3126279 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58037/solr ready
   [junit4]   2> 3126285 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 3126285 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3126288 INFO  (qtp417541079-35153) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 3126288 INFO  (qtp417541079-35153) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 3126289 INFO  (qtp417541079-35155) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={_stateVer_=cdcr-cluster2:4&action=COLLECTIONCHECKPOINT&wt=javabin&version=2} status=0 QTime=8
   [junit4]   2> 3126289 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrReplicatorManager Create new update log reader for target cdcr-cluster2 with checkpoint -1 @ cdcr-cluster1:shard2
   [junit4]   2> 3126289 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrReplicatorManager Attempting to bootstrap target collection: cdcr-cluster2, shard: shard2
   [junit4]   2> 3126295 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrReplicatorManager Submitting bootstrap task to executor
   [junit4]   2> 3126297 INFO  (cdcr-bootstrap-status-10729-thread-1-processing-n:127.0.0.1:55684_solr x:cdcr-cluster1_shard2_replica_n2 c:cdcr-cluster1 s:shard2 r:core_node4) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrReplicatorManager Attempting to bootstrap target collection: cdcr-cluster2 shard: shard2 leader: http://127.0.0.1:60814/solr/cdcr-cluster2_shard2_replica_n2/
   [junit4]   2> 3126297 INFO  (zkCallback-10698-thread-1) [    ] o.a.s.h.CdcrProcessStateManager The CDCR process state has changed: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-cluster1/cdcr/state/process @ cdcr-cluster1:shard2
   [junit4]   2> 3126297 INFO  (zkCallback-10698-thread-2) [    ] o.a.s.h.CdcrProcessStateManager The CDCR process state has changed: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-cluster1/cdcr/state/process @ cdcr-cluster1:shard1
   [junit4]   2> 3126297 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster1_shard2_replica_n2]  webapp=/solr path=/cdcr params={qt=/cdcr&_stateVer_=cdcr-cluster1:4&action=start&wt=javabin&version=2} status=0 QTime=25
   [junit4]   2> 3126297 INFO  (zkCallback-10698-thread-1) [    ] o.a.s.h.CdcrProcessStateManager Received new CDCR process state from watcher: STARTED @ cdcr-cluster1:shard2
   [junit4]   2> 3126297 INFO  (zkCallback-10698-thread-2) [    ] o.a.s.h.CdcrProcessStateManager Received new CDCR process state from watcher: STARTED @ cdcr-cluster1:shard1
   [junit4]   2> 3126299 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={qt=/cdcr&masterUrl=http://127.0.0.1:55684/solr/cdcr-cluster1_shard2_replica_n2/&action=BOOTSTRAP&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 3126299 INFO  (zkConnectionManagerCallback-10738-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3126300 INFO  (zkCallback-10698-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3126301 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 3126301 INFO  (qtp417541079-35150) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3126302 INFO  (cdcr-bootstrap-status-10729-thread-1-processing-n:127.0.0.1:55684_solr x:cdcr-cluster1_shard2_replica_n2 c:cdcr-cluster1 s:shard2 r:core_node4) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrReplicatorManager CDCR bootstrap running for 1 seconds, sleeping for 2000 ms
   [junit4]   2> 3126302 INFO  (zkCallback-10698-thread-2) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58037/solr ready
   [junit4]   2> 3126303 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606920808862580736,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 3126303 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 3126303 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 3126304 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster1_shard2_replica_n2]  webapp=/solr path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3126305 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 3126306 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3126306 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster1_shard2_replica_n2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 3126306 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 3126306 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 3126306 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 3126306 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 3126306 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 3126307 INFO  (qtp417541079-35154) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 3126308 INFO  (qtp417541079-35154) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 3126308 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@796df6f3[cdcr-cluster2_shard2_replica_n2] main]
   [junit4]   2> 3126308 INFO  (qtp417541079-35150) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={_stateVer_=cdcr-cluster2:4&action=COLLECTIONCHECKPOINT&wt=javabin&version=2} status=0 QTime=5
   [junit4]   2> 3126308 INFO  (zkCallback-10698-thread-2) [    ] o.a.s.h.CdcrReplicatorManager Create new update log reader for target cdcr-cluster2 with checkpoint -1 @ cdcr-cluster1:shard1
   [junit4]   2> 3126308 INFO  (zkCallback-10698-thread-2) [    ] o.a.s.h.CdcrReplicatorManager Attempting to bootstrap target collection: cdcr-cluster2, shard: shard1
   [junit4]   2> 3126308 INFO  (zkCallback-10698-thread-2) [    ] o.a.s.h.CdcrReplicatorManager Submitting bootstrap task to executor
   [junit4]   2> 3126309 INFO  (searcherExecutor-12556-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SolrCore [cdcr-cluster2_shard2_replica_n2] Registered new searcher Searcher@796df6f3[cdcr-cluster2_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3126309 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.CdcrRequestHandler No replay needed.
   [junit4]   2> 3126309 INFO  (cdcr-bootstrap-status-10734-thread-1) [    ] o.a.s.h.CdcrReplicatorManager Attempting to bootstrap target collection: cdcr-cluster2 shard: shard1 leader: http://127.0.0.1:60814/solr/cdcr-cluster2_shard1_replica_n1/
   [junit4]   2> 3126310 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&masterUrl=http://127.0.0.1:55684/solr/cdcr-cluster1_shard1_replica_n1/&action=BOOTSTRAP&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3126310 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 3126311 INFO  (qtp417541079-35150) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3126311 INFO  (cdcr-bootstrap-status-10734-thread-1) [    ] o.a.s.h.CdcrReplicatorManager CDCR bootstrap running for 1 seconds, sleeping for 2000 ms
   [junit4]   2> 3126312 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606920808872017920,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 3126314 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 3126319 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 3126319 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster1_shard1_replica_n1]  webapp=/solr path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2} status=0 QTime=7
   [junit4]   2> 3126320 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster1_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 3126320 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 3126320 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 3126320 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 3126320 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 3126320 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 3126322 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1383b5f[cdcr-cluster2_shard1_replica_n1] main]
   [junit4]   2> 3126323 INFO  (searcherExecutor-12555-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-cluster2_shard1_replica_n1] Registered new searcher Searcher@1383b5f[cdcr-cluster2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3126323 INFO  (recoveryExecutor-10670-thread-1-processing-n:127.0.0.1:60814_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrRequestHandler No replay needed.
   [junit4]   2> 3128299 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.c.CdcrBidirectionalTest Adding 10 docs with commit=true, numDocs=100
   [junit4]   2> 3128303 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster1/terms/shard1 to Terms{values={core_node3=1}, version=1}
   [junit4]   2> 3128303 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster1_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-cluster1:4&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 3128303 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster1/terms/shard2 to Terms{values={core_node4=1}, version=1}
   [junit4]   2> 3128303 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster1_shard2_replica_n2]  webapp=/solr path=/update params={_stateVer_=cdcr-cluster1:4&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 3128303 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3128304 INFO  (cdcr-bootstrap-status-10729-thread-1-processing-n:127.0.0.1:55684_solr x:cdcr-cluster1_shard2_replica_n2 c:cdcr-cluster1 s:shard2 r:core_node4) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrReplicatorManager CDCR bootstrap successful in 3 seconds
   [junit4]   2> 3128306 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 3128306 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3128307 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606920810963927040,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 3128307 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3dff5d82 commitCommandVersion:1606920810963927040
   [junit4]   2> 3128307 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 3128307 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3128307 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606920810963927040,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 3128310 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@45d999a commitCommandVersion:1606920810963927040
   [junit4]   2> 3128311 INFO  (qtp417541079-35150) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={_stateVer_=cdcr-cluster2:4&action=COLLECTIONCHECKPOINT&wt=javabin&version=2} status=0 QTime=7
   [junit4]   2> 3128312 INFO  (cdcr-bootstrap-status-10729-thread-1-processing-n:127.0.0.1:55684_solr x:cdcr-cluster1_shard2_replica_n2 c:cdcr-cluster1 s:shard2 r:core_node4) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrReplicatorManager Create new update log reader for target cdcr-cluster2 with checkpoint -1 @ cdcr-cluster1:shard2
   [junit4]   2> 3128313 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3128313 INFO  (cdcr-bootstrap-status-10734-thread-1) [    ] o.a.s.h.CdcrReplicatorManager CDCR bootstrap successful in 3 seconds
   [junit4]   2> 3128314 INFO  (cdcr-bootstrap-status-10729-thread-1-processing-n:127.0.0.1:55684_solr x:cdcr-cluster1_shard2_replica_n2 c:cdcr-cluster1 s:shard2 r:core_node4) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrReplicatorManager Bootstrap successful, giving the go-ahead to replicator
   [junit4]   2> 3128318 INFO  (qtp417541079-35150) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 3128318 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 3128318 INFO  (qtp417541079-35150) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3128318 INFO  (qtp417541079-35151) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3128319 INFO  (qtp417541079-35148) [n:127.0.0.1:60814_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={_stateVer_=cdcr-cluster2:4&action=COLLECTIONCHECKPOINT&wt=javabin&version=2} status=0 QTime=5
   [junit4]   2> 3128319 INFO  (cdcr-bootstrap-status-10734-thread-1) [    ] o.a.s.h.CdcrReplicatorManager Create new update log reader for target cdcr-cluster2 with checkpoint -1 @ cdcr-cluster1:shard1
   [junit4]   2> 3128320 INFO  (cdcr-bootstrap-status-10734-thread-1) [    ] o.a.s.h.CdcrReplicatorManager Bootstrap successful, giving the go-ahead to replicator
   [junit4]   2> 3128418 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6b24531e[cdcr-cluster1_shard1_replica_n1] main]
   [junit4]   2> 3128418 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 3128419 INFO  (searcherExecutor-12544-thread-1-processing-n:127.0.0.1:55684_solr x:cdcr-cluster1_shard1_replica_n1 c:cdcr-cluster1 s:shard1 r:core_node3) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-cluster1_shard1_replica_n1] Registered new searcher Searcher@6b24531e[cdcr-cluster1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C43)))}
   [junit4]   2> 3128419 INFO  (qtp1752523801-35205) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster1_shard1_replica_n1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&update.chain=cdcr-processor-chain&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:55684/solr/cdcr-cluster1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false} status=0 QTime=112
   [junit4]   2> 3128429 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@3f899a59[cdcr-cluster1_shard2_replica_n2] main]
   [junit4]   2> 3128430 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 3128430 INFO  (searcherExecutor-12543-thread-1-processing-n:127.0.0.1:55684_solr x:cdcr-cluster1_shard2_replica_n2 c:cdcr-cluster1 s:shard2 r:core_node4) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SolrCore [cdcr-cluster1_shard2_replica_n2] Registered new searcher Searcher@3f899a59[cdcr-cluster1_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C57)))}
   [junit4]   2> 3128430 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster1_shard2_replica_n2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&update.chain=cdcr-processor-chain&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:55684/solr/cdcr-cluster1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false} status=0 QTime=123
   [junit4]   2> 3128431 INFO  (qtp1752523801-35204) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster1_shard2_replica_n2]  webapp=/solr path=/update params={_stateVer_=cdcr-cluster1:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=126
   [junit4]   2> 3128431 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[39F83CE73F1F8D77]) [    ] o.a.s.c.c.CdcrBidirectionalTest Adding 10 docs with commit=true, numDocs=200
   [junit4]   2> 3128438 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster1_shard2_replica_n2]  webapp=/solr path=/update params={_stateVer_=cdcr-cluster1:4&wt=javabin&version=2} status=0 QTime=6
   [junit4]   2> 3128438 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster1_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-cluster1:4&wt=javabin&version=2} status=0 QTime=6
   [junit4]   2> 3128439 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606920811102339072,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 3128439 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606920811102339072,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 3128439 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3dff5d82 commitCommandVersion:1606920811102339072
   [junit4]   2> 3128439 INFO  (qtp1752523801-35209) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@45d999a commitCommandVersion:1606920811102339072
   [junit4]   2> 3128515 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@330b9094[cdcr-cluster1_shard1_replica_n1] main]
   [junit4]   2> 3128516 INFO  (qtp1752523801-35202) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 3128516 INFO  (searcherExecutor-12544-thread-1-processing-n:127.0.0.1:55684_solr x:cdcr-cluster1_shard1_replica_n1 c:cdcr-cluster1 s:shard1 r:core_node3) [n:127.0.0.1:55684_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-cluster1_shard1_replica_n1] Registered new searcher Searcher

[...truncated too long message...]

lint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] Creating empty /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/classes/test/org/apache/solr/cloud/autoscaling/sim/package-info.class
     [copy] Copying 1 file to /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/classes/test

common-solr.compile-test:

compile-test:

BUILD SUCCESSFUL
Total time: 55 seconds
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.CdcrBidirectionalTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseG1GC" -Dtests.seed=39F83CE73F1F8D77 -Dtests.slow=true -Dtests.locale=en-GB -Dtests.timezone=Etc/GMT0 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
Buildfile: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/build.xml

-clover.disable:

ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/top-level-ivy-settings.xml

install-junit4-taskdef:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 14ms :: artifacts dl 0ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
	---------------------------------------------------------------------

-init-totals:

-test:
    [mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: 39F83CE73F1F8D77
    [mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/temp
   [junit4] <JUnit4> says 你好! Master seed: 39F83CE73F1F8D77
   [junit4] Executing 5 suites with 2 JVMs.
   [junit4] 
   [junit4] Started J0 PID(11285@serv1-vm3).
   [junit4] Started J1 PID(11286@serv1-vm3).
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
   [junit4] OK      30.1s J1 | CdcrBidirectionalTest.testBiDir
   [junit4] Completed [1/5] on J1 in 32.24s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
   [junit4] OK      29.8s J0 | CdcrBidirectionalTest.testBiDir
   [junit4] Completed [2/5] on J0 in 32.67s, 1 test
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
   [junit4] OK      26.1s J0 | CdcrBidirectionalTest.testBiDir
   [junit4] Completed [3/5] on J0 in 26.10s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
   [junit4] OK      26.0s J1 | CdcrBidirectionalTest.testBiDir
   [junit4] Completed [4/5] on J1 in 26.51s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
   [junit4] OK      21.6s J0 | CdcrBidirectionalTest.testBiDir
   [junit4] Completed [5/5] on J0 in 21.62s, 1 test
   [junit4] 
   [junit4] JVM J0:     0.72 ..    81.69 =    80.97s
   [junit4] JVM J1:     0.72 ..    60.58 =    59.85s
   [junit4] Execution time total: 1 minute 21 seconds
   [junit4] Tests summary: 5 suites, 5 tests
   [junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp])
   [junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp])
     [echo] 5 slowest tests:
[junit4:tophints] 117.79s | org.apache.solr.cloud.ZkFailoverTest
[junit4:tophints] 117.08s | org.apache.solr.update.SoftAutoCommitTest
[junit4:tophints] 111.58s | org.apache.solr.cloud.TestTlogReplica
[junit4:tophints] 107.98s | org.apache.solr.cloud.DeleteReplicaTest
[junit4:tophints] 102.62s | org.apache.solr.cloud.TestPullReplica

-check-totals:

test-nocompile:

BUILD SUCCESSFUL
Total time: 1 minute 24 seconds
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
	at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2843)
	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2722)
	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2703)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3082)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to Solaris VBOX
		at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
		at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
		at hudson.remoting.Channel.call(Channel.java:955)
		at hudson.FilePath.act(FilePath.java:1089)
		at hudson.FilePath.act(FilePath.java:1078)
		at hudson.FilePath.validateAntFileMask(FilePath.java:2701)
		at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
		at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
		at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
		at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
		at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
		at hudson.model.Build$BuildExecution.post2(Build.java:186)
		at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
		at hudson.model.Run.execute(Run.java:1840)
		at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
		at hudson.model.ResourceController.execute(ResourceController.java:97)
		at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3084)
	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
	at hudson.remoting.Request$2.run(Request.java:369)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
	at hudson.FilePath.act(FilePath.java:1091)
	at hudson.FilePath.act(FilePath.java:1078)
	at hudson.FilePath.validateAntFileMask(FilePath.java:2701)
	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
	at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
	at hudson.model.Build$BuildExecution.post2(Build.java:186)
	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
	at hudson.model.Run.execute(Run.java:1840)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=a254e7d7bcd11c2163dfbb7b3d4a3986aee7867b, workspace=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris
[WARNINGS] Computing warning deltas based on reference build #1989
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1989 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1989/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC

3 tests failed.
FAILED:  org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart

Error Message:
IOException occured when talking to server at: http://127.0.0.1:45409/solr

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:45409/solr
	at __randomizedtesting.SeedInfo.seed([F2CDD2618676C20:27B94F73CBEABD7B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader(TestCloudConsistency.java:114)
	at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart(TestCloudConsistency.java:99)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:45409 failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 50 more


FAILED:  org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir

Error Message:
Captured an uncaught exception in thread: Thread[id=970, name=cdcr-replicator-251-thread-1, state=RUNNABLE, group=TGRP-CdcrBidirectionalTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=970, name=cdcr-replicator-251-thread-1, state=RUNNABLE, group=TGRP-CdcrBidirectionalTest]
Caused by: java.lang.AssertionError: 1606878424192778240 != 1606878424188583936
	at __randomizedtesting.SeedInfo.seed([F2CDD2618676C20]:0)
	at org.apache.solr.update.CdcrUpdateLog$CdcrLogReader.forwardSeek(CdcrUpdateLog.java:611)
	at org.apache.solr.handler.CdcrReplicator.run(CdcrReplicator.java:125)
	at org.apache.solr.handler.CdcrReplicatorScheduler.lambda$null$0(CdcrReplicatorScheduler.java:81)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir

Error Message:
Captured an uncaught exception in thread: Thread[id=4188, name=cdcr-replicator-1273-thread-1, state=RUNNABLE, group=TGRP-CdcrBidirectionalTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4188, name=cdcr-replicator-1273-thread-1, state=RUNNABLE, group=TGRP-CdcrBidirectionalTest]
Caused by: java.lang.AssertionError: 1606873252728143872 != 1606873252278304768
	at __randomizedtesting.SeedInfo.seed([F2CDD2618676C20]:0)
	at org.apache.solr.update.CdcrUpdateLog$CdcrLogReader.forwardSeek(CdcrUpdateLog.java:611)
	at org.apache.solr.handler.CdcrReplicator.run(CdcrReplicator.java:125)
	at org.apache.solr.handler.CdcrReplicatorScheduler.lambda$null$0(CdcrReplicatorScheduler.java:81)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12358 lines...]
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
   [junit4]   2> 352291 INFO  (SUITE-CdcrBidirectionalTest-seed#[F2CDD2618676C20]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/init-core-data-001
   [junit4]   2> 352291 WARN  (SUITE-CdcrBidirectionalTest-seed#[F2CDD2618676C20]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 352292 INFO  (SUITE-CdcrBidirectionalTest-seed#[F2CDD2618676C20]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 352293 INFO  (SUITE-CdcrBidirectionalTest-seed#[F2CDD2618676C20]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 352298 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBiDir
   [junit4]   2> 352298 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster2-001
   [junit4]   2> 352302 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 352302 INFO  (Thread-888) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 352302 INFO  (Thread-888) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 352308 ERROR (Thread-888) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 352403 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.ZkTestServer start zk server on port:57772
   [junit4]   2> 352410 INFO  (zkConnectionManagerCallback-707-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 352429 INFO  (jetty-launcher-704-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c95df4e{/solr,null,AVAILABLE}
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4e818b72{SSL,[ssl, http/1.1]}{127.0.0.1:37192}
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.e.j.s.Server Started @352696ms
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37192}
   [junit4]   2> 352430 ERROR (jetty-launcher-704-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 352430 INFO  (jetty-launcher-704-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-07-24T12:02:09.280Z
   [junit4]   2> 352440 INFO  (zkConnectionManagerCallback-709-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 352440 INFO  (jetty-launcher-704-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 353289 INFO  (jetty-launcher-704-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57772/solr
   [junit4]   2> 353292 INFO  (zkConnectionManagerCallback-713-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 353295 INFO  (zkConnectionManagerCallback-715-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 353436 INFO  (jetty-launcher-704-thread-1) [n:127.0.0.1:37192_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37192_solr
   [junit4]   2> 353437 INFO  (jetty-launcher-704-thread-1) [n:127.0.0.1:37192_solr    ] o.a.s.c.Overseer Overseer (id=72562416009740291-127.0.0.1:37192_solr-n_0000000000) starting
   [junit4]   2> 353453 INFO  (zkConnectionManagerCallback-722-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 353457 INFO  (jetty-launcher-704-thread-1) [n:127.0.0.1:37192_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57772/solr ready
   [junit4]   2> 353463 INFO  (OverseerStateUpdate-72562416009740291-127.0.0.1:37192_solr-n_0000000000) [    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:37192_solr
   [junit4]   2> 353463 INFO  (jetty-launcher-704-thread-1) [n:127.0.0.1:37192_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37192_solr
   [junit4]   2> 353471 INFO  (zkCallback-721-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 353472 INFO  (OverseerStateUpdate-72562416009740291-127.0.0.1:37192_solr-n_0000000000) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 353496 INFO  (jetty-launcher-704-thread-1) [n:127.0.0.1:37192_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 353520 INFO  (jetty-launcher-704-thread-1) [n:127.0.0.1:37192_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37192.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21fb3568
   [junit4]   2> 353526 INFO  (jetty-launcher-704-thread-1) [n:127.0.0.1:37192_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37192.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21fb3568
   [junit4]   2> 353527 INFO  (jetty-launcher-704-thread-1) [n:127.0.0.1:37192_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37192.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21fb3568
   [junit4]   2> 353528 INFO  (jetty-launcher-704-thread-1) [n:127.0.0.1:37192_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster2-001/node1/.
   [junit4]   2> 353541 INFO  (zkConnectionManagerCallback-725-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 353546 INFO  (zkConnectionManagerCallback-728-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 353551 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x101cb22064e0006, likely client has closed socket
   [junit4]   2> 353551 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster1-001
   [junit4]   2> 353551 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 353551 INFO  (Thread-899) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 353551 INFO  (Thread-899) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 353554 ERROR (Thread-899) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 353652 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.ZkTestServer start zk server on port:40107
   [junit4]   2> 353659 INFO  (zkConnectionManagerCallback-732-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 353689 INFO  (jetty-launcher-729-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 353691 INFO  (jetty-launcher-729-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 353691 INFO  (jetty-launcher-729-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 353691 INFO  (jetty-launcher-729-thread-1) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 353691 INFO  (jetty-launcher-729-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@76ac8a35{/solr,null,AVAILABLE}
   [junit4]   2> 353691 INFO  (jetty-launcher-729-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@71fbdd7{SSL,[ssl, http/1.1]}{127.0.0.1:60263}
   [junit4]   2> 353692 INFO  (jetty-launcher-729-thread-1) [    ] o.e.j.s.Server Started @353959ms
   [junit4]   2> 353692 INFO  (jetty-launcher-729-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60263}
   [junit4]   2> 353694 ERROR (jetty-launcher-729-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 353694 INFO  (jetty-launcher-729-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 353694 INFO  (jetty-launcher-729-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 353694 INFO  (jetty-launcher-729-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 353694 INFO  (jetty-launcher-729-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 353694 INFO  (jetty-launcher-729-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-07-24T12:02:10.544Z
   [junit4]   2> 353697 INFO  (zkConnectionManagerCallback-734-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 353698 INFO  (jetty-launcher-729-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 353858 INFO  (jetty-launcher-729-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40107/solr
   [junit4]   2> 353860 INFO  (zkConnectionManagerCallback-738-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 353864 INFO  (zkConnectionManagerCallback-740-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 353999 INFO  (jetty-launcher-729-thread-1) [n:127.0.0.1:60263_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60263_solr
   [junit4]   2> 354001 INFO  (jetty-launcher-729-thread-1) [n:127.0.0.1:60263_solr    ] o.a.s.c.Overseer Overseer (id=72562416091594755-127.0.0.1:60263_solr-n_0000000000) starting
   [junit4]   2> 354013 INFO  (zkConnectionManagerCallback-747-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 354016 INFO  (jetty-launcher-729-thread-1) [n:127.0.0.1:60263_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40107/solr ready
   [junit4]   2> 354018 INFO  (OverseerStateUpdate-72562416091594755-127.0.0.1:60263_solr-n_0000000000) [    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:60263_solr
   [junit4]   2> 354018 INFO  (jetty-launcher-729-thread-1) [n:127.0.0.1:60263_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60263_solr
   [junit4]   2> 354027 INFO  (zkCallback-746-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 354027 INFO  (zkCallback-739-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 354046 INFO  (jetty-launcher-729-thread-1) [n:127.0.0.1:60263_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 354074 INFO  (jetty-launcher-729-thread-1) [n:127.0.0.1:60263_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60263.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21fb3568
   [junit4]   2> 354079 INFO  (jetty-launcher-729-thread-1) [n:127.0.0.1:60263_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60263.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21fb3568
   [junit4]   2> 354079 INFO  (jetty-launcher-729-thread-1) [n:127.0.0.1:60263_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60263.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21fb3568
   [junit4]   2> 354080 INFO  (jetty-launcher-729-thread-1) [n:127.0.0.1:60263_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster1-001/node1/.
   [junit4]   2> 354099 INFO  (zkConnectionManagerCallback-750-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 354103 INFO  (zkConnectionManagerCallback-753-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 354105 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.c.CdcrBidirectionalTest cluster2 zkHost = 127.0.0.1:57772/solr
   [junit4]   2> 354106 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.c.CdcrBidirectionalTest cluster1 zkHost = 127.0.0.1:40107/solr
   [junit4]   2> 354108 INFO  (zkConnectionManagerCallback-755-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 354115 INFO  (zkConnectionManagerCallback-759-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 354117 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 354119 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40107/solr ready
   [junit4]   2> 354157 INFO  (qtp819609209-4044) [n:127.0.0.1:60263_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=cdcr-cluster1&maxShardsPerNode=2&name=cdcr-cluster1&nrtReplicas=1&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 354167 INFO  (OverseerThreadFactory-1231-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection cdcr-cluster1
   [junit4]   2> 354285 INFO  (OverseerStateUpdate-72562416091594755-127.0.0.1:60263_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"cdcr-cluster1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"cdcr-cluster1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:60263/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 354289 INFO  (OverseerStateUpdate-72562416091594755-127.0.0.1:60263_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"cdcr-cluster1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"cdcr-cluster1_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:60263/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 354511 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr    x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-cluster1&newCollection=true&collection=cdcr-cluster1&version=2&replicaType=NRT&coreNodeName=core_node3&name=cdcr-cluster1_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 354511 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr    x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 354517 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr    x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-cluster1&newCollection=true&collection=cdcr-cluster1&version=2&replicaType=NRT&coreNodeName=core_node4&name=cdcr-cluster1_shard2_replica_n2&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 355551 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 355551 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 355559 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.IndexSchema [cdcr-cluster1_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 355559 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.IndexSchema [cdcr-cluster1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 355561 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 355561 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 355561 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-cluster1_shard1_replica_n1' using configuration from collection cdcr-cluster1, trusted=true
   [junit4]   2> 355561 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-cluster1_shard2_replica_n2' using configuration from collection cdcr-cluster1, trusted=true
   [junit4]   2> 355561 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60263.solr.core.cdcr-cluster1.shard2.replica_n2' (registry 'solr.core.cdcr-cluster1.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21fb3568
   [junit4]   2> 355561 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60263.solr.core.cdcr-cluster1.shard1.replica_n1' (registry 'solr.core.cdcr-cluster1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21fb3568
   [junit4]   2> 355561 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 355561 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 355561 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SolrCore [[cdcr-cluster1_shard2_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster1-001/node1/cdcr-cluster1_shard2_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster1-001/node1/./cdcr-cluster1_shard2_replica_n2/data/]
   [junit4]   2> 355561 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SolrCore [[cdcr-cluster1_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster1-001/node1/cdcr-cluster1_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster1-001/node1/./cdcr-cluster1_shard1_replica_n1/data/]
   [junit4]   2> 355816 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 355816 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 355816 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 355817 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 355818 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 355818 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 355818 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 355818 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 355820 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@e674e53[cdcr-cluster1_shard1_replica_n1] main]
   [junit4]   2> 355820 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@75c38736[cdcr-cluster1_shard2_replica_n2] main]
   [junit4]   2> 355822 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-cluster1
   [junit4]   2> 355822 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-cluster1
   [junit4]   2> 355822 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-cluster1
   [junit4]   2> 355822 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-cluster1
   [junit4]   2> 355822 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-cluster1/managed-schema
   [junit4]   2> 355822 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-cluster1/managed-schema
   [junit4]   2> 355823 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 355823 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 355824 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 355824 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 355834 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrBufferStateManager Created znode /collections/cdcr-cluster1/cdcr/state/buffer
   [junit4]   2> 355841 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.h.CdcrProcessStateManager Created znode /collections/cdcr-cluster1/cdcr/state/process
   [junit4]   2> 355873 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606873233723752448
   [junit4]   2> 355873 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606873233723752448
   [junit4]   2> 355876 INFO  (searcherExecutor-1236-thread-1-processing-n:127.0.0.1:60263_solr x:cdcr-cluster1_shard1_replica_n1 c:cdcr-cluster1 s:shard1 r:core_node3) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-cluster1_shard1_replica_n1] Registered new searcher Searcher@e674e53[cdcr-cluster1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 355879 INFO  (searcherExecutor-1237-thread-1-processing-n:127.0.0.1:60263_solr x:cdcr-cluster1_shard2_replica_n2 c:cdcr-cluster1 s:shard2 r:core_node4) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SolrCore [cdcr-cluster1_shard2_replica_n2] Registered new searcher Searcher@75c38736[cdcr-cluster1_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 355893 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster1/terms/shard2 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 355896 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster1/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 355908 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 355908 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 355908 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:60263/solr/cdcr-cluster1_shard2_replica_n2/
   [junit4]   2> 355908 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 355909 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 355909 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 355909 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:60263/solr/cdcr-cluster1_shard1_replica_n1/
   [junit4]   2> 355909 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.SyncStrategy https://127.0.0.1:60263/solr/cdcr-cluster1_shard2_replica_n2/ has no replicas
   [junit4]   2> 355910 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 355910 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 355911 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:60263/solr/cdcr-cluster1_shard1_replica_n1/ has no replicas
   [junit4]   2> 355911 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 355915 INFO  (zkCallback-739-thread-2) [    ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-cluster1:shard2
   [junit4]   2> 355915 INFO  (zkCallback-739-thread-1) [    ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-cluster1:shard1
   [junit4]   2> 355924 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:60263/solr/cdcr-cluster1_shard2_replica_n2/ shard2
   [junit4]   2> 355925 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:60263/solr/cdcr-cluster1_shard1_replica_n1/ shard1
   [junit4]   2> 356029 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 356030 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 356037 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=cdcr-cluster1&newCollection=true&collection=cdcr-cluster1&version=2&replicaType=NRT&coreNodeName=core_node4&name=cdcr-cluster1_shard2_replica_n2&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=1521
   [junit4]   2> 356038 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=cdcr-cluster1&newCollection=true&collection=cdcr-cluster1&version=2&replicaType=NRT&coreNodeName=core_node3&name=cdcr-cluster1_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=1527
   [junit4]   2> 356045 INFO  (qtp819609209-4044) [n:127.0.0.1:60263_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 356143 INFO  (zkCallback-739-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-cluster1/state.json] for collection [cdcr-cluster1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 356171 INFO  (OverseerCollectionConfigSetProcessor-72562416091594755-127.0.0.1:60263_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 357046 INFO  (qtp819609209-4044) [n:127.0.0.1:60263_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=cdcr-cluster1&maxShardsPerNode=2&name=cdcr-cluster1&nrtReplicas=1&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2} status=0 QTime=2890
   [junit4]   2> 357049 INFO  (zkConnectionManagerCallback-763-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 357057 INFO  (zkConnectionManagerCallback-767-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 357059 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 357060 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57772/solr ready
   [junit4]   2> 357103 INFO  (qtp2012573986-3988) [n:127.0.0.1:37192_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=cdcr-cluster2&maxShardsPerNode=2&name=cdcr-cluster2&nrtReplicas=1&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 357109 INFO  (OverseerThreadFactory-1218-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection cdcr-cluster2
   [junit4]   2> 357228 INFO  (OverseerStateUpdate-72562416009740291-127.0.0.1:37192_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"cdcr-cluster2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"cdcr-cluster2_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:37192/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 357233 INFO  (OverseerStateUpdate-72562416009740291-127.0.0.1:37192_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"cdcr-cluster2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"cdcr-cluster2_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:37192/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 357471 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr    x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-cluster2&newCollection=true&collection=cdcr-cluster2&version=2&replicaType=NRT&coreNodeName=core_node4&name=cdcr-cluster2_shard2_replica_n2&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 357471 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr    x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-cluster2&newCollection=true&collection=cdcr-cluster2&version=2&replicaType=NRT&coreNodeName=core_node3&name=cdcr-cluster2_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 357471 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr    x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 358549 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 358549 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 358557 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.IndexSchema [cdcr-cluster2_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 358558 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.IndexSchema [cdcr-cluster2_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 358559 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 358559 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-cluster2_shard2_replica_n2' using configuration from collection cdcr-cluster2, trusted=true
   [junit4]   2> 358560 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37192.solr.core.cdcr-cluster2.shard2.replica_n2' (registry 'solr.core.cdcr-cluster2.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21fb3568
   [junit4]   2> 358560 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 358560 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 358560 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SolrCore [[cdcr-cluster2_shard2_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster2-001/node1/cdcr-cluster2_shard2_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster2-001/node1/./cdcr-cluster2_shard2_replica_n2/data/]
   [junit4]   2> 358560 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-cluster2_shard1_replica_n1' using configuration from collection cdcr-cluster2, trusted=true
   [junit4]   2> 358561 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37192.solr.core.cdcr-cluster2.shard1.replica_n1' (registry 'solr.core.cdcr-cluster2.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21fb3568
   [junit4]   2> 358561 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 358562 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SolrCore [[cdcr-cluster2_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster2-001/node1/cdcr-cluster2_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrBidirectionalTest_F2CDD2618676C20-001/cdcr-cluster2-001/node1/./cdcr-cluster2_shard1_replica_n1/data/]
   [junit4]   2> 358737 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 358737 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 358738 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 358738 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 358738 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 358739 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 358740 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 358740 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 358741 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@326a3921[cdcr-cluster2_shard1_replica_n1] main]
   [junit4]   2> 358742 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@7e0782eb[cdcr-cluster2_shard2_replica_n2] main]
   [junit4]   2> 358743 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-cluster2
   [junit4]   2> 358744 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-cluster2
   [junit4]   2> 358744 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-cluster2/managed-schema
   [junit4]   2> 358744 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-cluster2
   [junit4]   2> 358746 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-cluster2
   [junit4]   2> 358746 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-cluster2/managed-schema
   [junit4]   2> 358747 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 358748 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 358748 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 358749 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 358753 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrBufferStateManager Created znode /collections/cdcr-cluster2/cdcr/state/buffer
   [junit4]   2> 358755 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrProcessStateManager Created znode /collections/cdcr-cluster2/cdcr/state/process
   [junit4]   2> 358758 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606873236748894208
   [junit4]   2> 358758 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606873236748894208
   [junit4]   2> 358766 INFO  (searcherExecutor-1248-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SolrCore [cdcr-cluster2_shard2_replica_n2] Registered new searcher Searcher@7e0782eb[cdcr-cluster2_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 358766 INFO  (searcherExecutor-1249-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-cluster2_shard1_replica_n1] Registered new searcher Searcher@326a3921[cdcr-cluster2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 358780 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster2/terms/shard2 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 358783 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster2/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 358793 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 358793 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 358793 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:37192/solr/cdcr-cluster2_shard2_replica_n2/
   [junit4]   2> 358793 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 358794 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SyncStrategy https://127.0.0.1:37192/solr/cdcr-cluster2_shard2_replica_n2/ has no replicas
   [junit4]   2> 358794 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 358795 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 358795 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 358795 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:37192/solr/cdcr-cluster2_shard1_replica_n1/
   [junit4]   2> 358796 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 358797 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:37192/solr/cdcr-cluster2_shard1_replica_n1/ has no replicas
   [junit4]   2> 358797 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 358798 INFO  (zkCallback-714-thread-2) [    ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-cluster2:shard2
   [junit4]   2> 358806 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:37192/solr/cdcr-cluster2_shard2_replica_n2/ shard2
   [junit4]   2> 358807 INFO  (zkCallback-714-thread-2) [    ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-cluster2:shard1
   [junit4]   2> 358816 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:37192/solr/cdcr-cluster2_shard1_replica_n1/ shard1
   [junit4]   2> 358921 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 358927 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=cdcr-cluster2&newCollection=true&collection=cdcr-cluster2&version=2&replicaType=NRT&coreNodeName=core_node3&name=cdcr-cluster2_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=1457
   [junit4]   2> 358966 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 358973 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=cdcr-cluster2&newCollection=true&collection=cdcr-cluster2&version=2&replicaType=NRT&coreNodeName=core_node4&name=cdcr-cluster2_shard2_replica_n2&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=1503
   [junit4]   2> 358985 INFO  (qtp2012573986-3988) [n:127.0.0.1:37192_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 359071 INFO  (zkCallback-714-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-cluster2/state.json] for collection [cdcr-cluster2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 359110 INFO  (OverseerCollectionConfigSetProcessor-72562416009740291-127.0.0.1:37192_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 359986 INFO  (qtp2012573986-3988) [n:127.0.0.1:37192_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=cdcr-cluster2&maxShardsPerNode=2&name=cdcr-cluster2&nrtReplicas=1&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2} status=0 QTime=2884
   [junit4]   2> 359997 INFO  (zkConnectionManagerCallback-774-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 359999 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 360004 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57772/solr ready
   [junit4]   2> 360105 INFO  (qtp2012573986-3990) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 360105 INFO  (qtp2012573986-3990) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=7
   [junit4]   2> 360111 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 360111 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 360112 INFO  (qtp2012573986-3993) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={_stateVer_=cdcr-cluster2:4&action=COLLECTIONCHECKPOINT&wt=javabin&version=2} status=0 QTime=81
   [junit4]   2> 360113 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Create new update log reader for target cdcr-cluster2 with checkpoint -1 @ cdcr-cluster1:shard1
   [junit4]   2> 360113 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Attempting to bootstrap target collection: cdcr-cluster2, shard: shard1
   [junit4]   2> 360122 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Submitting bootstrap task to executor
   [junit4]   2> 360125 INFO  (cdcr-bootstrap-status-770-thread-1-processing-n:127.0.0.1:60263_solr x:cdcr-cluster1_shard1_replica_n1 c:cdcr-cluster1 s:shard1 r:core_node3) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Attempting to bootstrap target collection: cdcr-cluster2 shard: shard1 leader: https://127.0.0.1:37192/solr/cdcr-cluster2_shard1_replica_n1/
   [junit4]   2> 360143 INFO  (zkCallback-739-thread-1) [    ] o.a.s.h.CdcrProcessStateManager The CDCR process state has changed: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-cluster1/cdcr/state/process @ cdcr-cluster1:shard2
   [junit4]   2> 360143 INFO  (zkCallback-739-thread-2) [    ] o.a.s.h.CdcrProcessStateManager The CDCR process state has changed: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-cluster1/cdcr/state/process @ cdcr-cluster1:shard1
   [junit4]   2> 360143 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster1_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&_stateVer_=cdcr-cluster1:4&action=start&wt=javabin&version=2} status=0 QTime=150
   [junit4]   2> 360144 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&masterUrl=https://127.0.0.1:60263/solr/cdcr-cluster1_shard1_replica_n1/&action=BOOTSTRAP&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 360145 INFO  (zkCallback-739-thread-2) [    ] o.a.s.h.CdcrProcessStateManager Received new CDCR process state from watcher: STARTED @ cdcr-cluster1:shard1
   [junit4]   2> 360145 INFO  (zkCallback-739-thread-1) [    ] o.a.s.h.CdcrProcessStateManager Received new CDCR process state from watcher: STARTED @ cdcr-cluster1:shard2
   [junit4]   2> 360153 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 360154 INFO  (zkConnectionManagerCallback-779-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 360168 INFO  (zkCallback-739-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 360180 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 360196 INFO  (zkCallback-739-thread-1) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57772/solr ready
   [junit4]   2> 360214 INFO  (cdcr-bootstrap-status-770-thread-1-processing-n:127.0.0.1:60263_solr x:cdcr-cluster1_shard1_replica_n1 c:cdcr-cluster1 s:shard1 r:core_node3) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager CDCR bootstrap running for 1 seconds, sleeping for 2000 ms
   [junit4]   2> 360243 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606873238306029568,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 360249 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 360275 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 360276 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster1_shard1_replica_n1]  webapp=/solr path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2} status=0 QTime=67
   [junit4]   2> 360334 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster1_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 360336 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 360336 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 360336 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 360336 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 360336 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 360390 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6fc478eb[cdcr-cluster2_shard1_replica_n1] main]
   [junit4]   2> 360391 INFO  (qtp2012573986-3986) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 360391 INFO  (qtp2012573986-3986) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 360391 INFO  (searcherExecutor-1249-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-cluster2_shard1_replica_n1] Registered new searcher Searcher@6fc478eb[cdcr-cluster2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 360410 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard1_replica_n1 c:cdcr-cluster2 s:shard1 r:core_node3) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrRequestHandler No replay needed.
   [junit4]   2> 360426 INFO  (qtp2012573986-3990) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 360426 INFO  (qtp2012573986-3990) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=8
   [junit4]   2> 360427 INFO  (qtp2012573986-3995) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={_stateVer_=cdcr-cluster2:4&action=COLLECTIONCHECKPOINT&wt=javabin&version=2} status=0 QTime=115
   [junit4]   2> 360430 INFO  (zkCallback-739-thread-1) [    ] o.a.s.h.CdcrReplicatorManager Create new update log reader for target cdcr-cluster2 with checkpoint -1 @ cdcr-cluster1:shard2
   [junit4]   2> 360430 INFO  (zkCallback-739-thread-1) [    ] o.a.s.h.CdcrReplicatorManager Attempting to bootstrap target collection: cdcr-cluster2, shard: shard2
   [junit4]   2> 360430 INFO  (zkCallback-739-thread-1) [    ] o.a.s.h.CdcrReplicatorManager Submitting bootstrap task to executor
   [junit4]   2> 360436 INFO  (cdcr-bootstrap-status-775-thread-1) [    ] o.a.s.h.CdcrReplicatorManager Attempting to bootstrap target collection: cdcr-cluster2 shard: shard2 leader: https://127.0.0.1:37192/solr/cdcr-cluster2_shard2_replica_n2/
   [junit4]   2> 360458 INFO  (qtp2012573986-3990) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={qt=/cdcr&masterUrl=https://127.0.0.1:60263/solr/cdcr-cluster1_shard2_replica_n2/&action=BOOTSTRAP&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 360458 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 360470 INFO  (qtp2012573986-3990) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 360470 INFO  (cdcr-bootstrap-status-775-thread-1) [    ] o.a.s.h.CdcrReplicatorManager CDCR bootstrap running for 1 seconds, sleeping for 2000 ms
   [junit4]   2> 360511 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606873238587047936,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 360522 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 360546 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 360546 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster1_shard2_replica_n2]  webapp=/solr path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2} status=0 QTime=34
   [junit4]   2> 360551 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster1_shard2_replica_n2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 360552 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 360552 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 360552 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 360552 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 360552 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 360596 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c4e8e62[cdcr-cluster2_shard2_replica_n2] main]
   [junit4]   2> 360598 INFO  (searcherExecutor-1248-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.SolrCore [cdcr-cluster2_shard2_replica_n2] Registered new searcher Searcher@1c4e8e62[cdcr-cluster2_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 360600 INFO  (recoveryExecutor-711-thread-1-processing-n:127.0.0.1:37192_solr x:cdcr-cluster2_shard2_replica_n2 c:cdcr-cluster2 s:shard2 r:core_node4) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.CdcrRequestHandler No replay needed.
   [junit4]   2> 362144 INFO  (TEST-CdcrBidirectionalTest.testBiDir-seed#[F2CDD2618676C20]) [    ] o.a.s.c.c.CdcrBidirectionalTest Adding 10 docs with commit=true, numDocs=100
   [junit4]   2> 362219 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 362220 INFO  (cdcr-bootstrap-status-770-thread-1-processing-n:127.0.0.1:60263_solr x:cdcr-cluster1_shard1_replica_n1 c:cdcr-cluster1 s:shard1 r:core_node3) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager CDCR bootstrap successful in 3 seconds
   [junit4]   2> 362238 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster1/terms/shard1 to Terms{values={core_node3=1}, version=1}
   [junit4]   2> 362238 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster1_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-cluster1:4&wt=javabin&version=2} status=0 QTime=31
   [junit4]   2> 362242 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-cluster1/terms/shard2 to Terms{values={core_node4=1}, version=1}
   [junit4]   2> 362242 INFO  (qtp819609209-4047) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster1_shard2_replica_n2]  webapp=/solr path=/update params={_stateVer_=cdcr-cluster1:4&wt=javabin&version=2} status=0 QTime=84
   [junit4]   2> 362251 INFO  (qtp2012573986-3986) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 362251 INFO  (qtp2012573986-3986) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard1 r:core_node3 x:cdcr-cluster2_shard1_replica_n1] o.a.s.c.S.Request [cdcr-cluster2_shard1_replica_n1]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 362270 INFO  (qtp2012573986-3993) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 362270 INFO  (qtp2012573986-3993) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 362270 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={_stateVer_=cdcr-cluster2:4&action=COLLECTIONCHECKPOINT&wt=javabin&version=2} status=0 QTime=49
   [junit4]   2> 362270 INFO  (cdcr-bootstrap-status-770-thread-1-processing-n:127.0.0.1:60263_solr x:cdcr-cluster1_shard1_replica_n1 c:cdcr-cluster1 s:shard1 r:core_node3) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Create new update log reader for target cdcr-cluster2 with checkpoint -1 @ cdcr-cluster1:shard1
   [junit4]   2> 362274 INFO  (cdcr-bootstrap-status-770-thread-1-processing-n:127.0.0.1:60263_solr x:cdcr-cluster1_shard1_replica_n1 c:cdcr-cluster1 s:shard1 r:core_node3) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Bootstrap successful, giving the go-ahead to replicator
   [junit4]   2> 362308 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606873240471339008,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 362308 INFO  (qtp819609209-4043) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard2 r:core_node4 x:cdcr-cluster1_shard2_replica_n2] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@acef68d commitCommandVersion:1606873240471339008
   [junit4]   2> 362323 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606873240487067648,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 362323 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@478b66f1 commitCommandVersion:1606873240487067648
   [junit4]   2> 362472 INFO  (qtp2012573986-3991) [n:127.0.0.1:37192_solr c:cdcr-cluster2 s:shard2 r:core_node4 x:cdcr-cluster2_shard2_replica_n2] o.a.s.c.S.Request [cdcr-cluster2_shard2_replica_n2]  webapp=/solr path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 362473 INFO  (cdcr-bootstrap-status-775-thread-1) [    ] o.a.s.h.CdcrReplicatorManager CDCR bootstrap successful in 3 seconds
   [junit4]   2> 362483 INFO  (qtp819609209-4046) [n:127.0.0.1:60263_solr c:cdcr-cluster1 s:shard1 r:core_node3 x:cdcr-cluster1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6a09a1c2[cdcr-cluster1_shard1_replica_n1] main]
   [junit4]   2> 362483 INFO  (qtp819609209-404

[...truncated too long message...]

ow=true -Dtests.badapples=true -Dtests.locale=nl-NL -Dtests.timezone=Australia/Queensland -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   23.7s J1 | CdcrBidirectionalTest.testBiDir <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=970, name=cdcr-replicator-251-thread-1, state=RUNNABLE, group=TGRP-CdcrBidirectionalTest]
   [junit4]    > Caused by: java.lang.AssertionError: 1606878424192778240 != 1606878424188583936
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F2CDD2618676C20]:0)
   [junit4]    > 	at org.apache.solr.update.CdcrUpdateLog$CdcrLogReader.forwardSeek(CdcrUpdateLog.java:611)
   [junit4]    > 	at org.apache.solr.handler.CdcrReplicator.run(CdcrReplicator.java:125)
   [junit4]    > 	at org.apache.solr.handler.CdcrReplicatorScheduler.lambda$null$0(CdcrReplicatorScheduler.java:81)
   [junit4]    > 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=979, name=cdcr-replicator-254-thread-1, state=RUNNABLE, group=TGRP-CdcrBidirectionalTest]
   [junit4]    > Caused by: java.lang.AssertionError: 1606878424410882048 != 1606878424188583936
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F2CDD2618676C20]:0)
   [junit4]    > 	at org.apache.solr.update.CdcrUpdateLog$CdcrLogReader.forwardSeek(CdcrUpdateLog.java:611)
   [junit4]    > 	at org.apache.solr.handler.CdcrReplicator.run(CdcrReplicator.java:125)
   [junit4]    > 	at org.apache.solr.handler.CdcrReplicatorScheduler.lambda$null$0(CdcrReplicatorScheduler.java:81)
   [junit4]    > 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)Throwable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=998, name=cdcr-replicator-251-thread-2, state=RUNNABLE, group=TGRP-CdcrBidirectionalTest]
   [junit4]    > Caused by: java.lang.AssertionError: 1606878424192778240 != 1606878424188583936
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F2CDD2618676C20]:0)
   [junit4]    > 	at org.apache.solr.update.CdcrUpdateLog$CdcrLogReader.forwardSeek(CdcrUpdateLog.java:611)
   [junit4]    > 	at org.apache.solr.handler.CdcrReplicator.run(CdcrReplicator.java:125)
   [junit4]    > 	at org.apache.solr.handler.CdcrReplicatorScheduler.lambda$null$0(CdcrReplicatorScheduler.java:81)
   [junit4]    > 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=999, name=cdcr-replicator-254-thread-2, state=RUNNABLE, group=TGRP-CdcrBidirectionalTest]
   [junit4]    > Caused by: java.lang.AssertionError: 1606878424410882048 != 1606878424188583936
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F2CDD2618676C20]:0)
   [junit4]    > 	at org.apache.solr.update.CdcrUpdateLog$CdcrLogReader.forwardSeek(CdcrUpdateLog.java:611)
   [junit4]    > 	at org.apache.solr.handler.CdcrReplicator.run(CdcrReplicator.java:125)
   [junit4]    > 	at org.apache.solr.handler.CdcrReplicatorScheduler.lambda$null$0(CdcrReplicatorScheduler.java:81)
   [junit4]    > 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 103588 INFO  (SUITE-CdcrBidirectionalTest-seed#[F2CDD2618676C20]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {abc=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), xyz=PostingsFormat(name=Direct), id=Lucene50(blocksize=128)}, docValues:{}, maxPointsInLeafNode=929, maxMBSortInHeap=7.389177121653228, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@6248b27f), locale=nl-NL, timezone=Australia/Queensland
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=3,threads=1,free=39209488,total=141733888
   [junit4]   2> NOTE: All tests run in this JVM: [TestCloudConsistency, CdcrBidirectionalTest]
   [junit4] Completed [3/10 (1!)] on J1 in 23.96s, 1 test, 1 error <<< FAILURES!
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
   [junit4] OK      22.9s J1 | CdcrBidirectionalTest.testBiDir
   [junit4] Completed [4/10 (1!)] on J1 in 22.97s, 1 test
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
   [junit4] OK      21.3s J1 | CdcrBidirectionalTest.testBiDir
   [junit4] Completed [5/10 (1!)] on J1 in 22.06s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.TestCloudConsistency
   [junit4] OK      31.4s J0 | TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
   [junit4] OK      25.8s J0 | TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
   [junit4] Completed [6/10 (1!)] on J0 in 71.10s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.TestCloudConsistency
   [junit4] OK      29.6s J1 | TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
   [junit4] OK      25.0s J1 | TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
   [junit4] Completed [7/10 (1!)] on J1 in 67.94s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.TestCloudConsistency
   [junit4] OK      28.9s J0 | TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
   [junit4] OK      25.0s J0 | TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
   [junit4] Completed [8/10 (1!)] on J0 in 68.40s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
   [junit4] OK      27.6s J1 | CdcrBidirectionalTest.testBiDir
   [junit4] Completed [9/10 (1!)] on J1 in 28.62s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
   [junit4] OK      27.9s J0 | CdcrBidirectionalTest.testBiDir
   [junit4] Completed [10/10 (1!)] on J0 in 28.40s, 1 test
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: F2CDD2618676C20]:
   [junit4]   - org.apache.solr.cloud.cdcr.CdcrBidirectionalTest.testBiDir
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.69 ..   247.51 =   246.82s
   [junit4] JVM J1:     0.69 ..   246.10 =   245.41s
   [junit4] Execution time total: 4 minutes 7 seconds
   [junit4] Tests summary: 10 suites, 15 tests, 1 error

BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1568: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1092: There were test failures: 10 suites, 15 tests, 1 error [seed: F2CDD2618676C20]

Total time: 4 minutes 9 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.TestCloudConsistency
[repro]   1/5 failed: org.apache.solr.cloud.cdcr.CdcrBidirectionalTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=d010cdd87eec89bf6308351b817d9ec1d5c6e14e, workspace=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris
[WARNINGS] Computing warning deltas based on reference build #1987
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1988 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1988/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.TestDistributedGrouping.test

Error Message:
.grouped[a_i1].doclist.maxScore:1.0!=null

Stack Trace:
junit.framework.AssertionFailedError: .grouped[a_i1].doclist.maxScore:1.0!=null
	at __randomizedtesting.SeedInfo.seed([375390BEC5F87A6C:BF07AF646B041794]:0)
	at junit.framework.Assert.fail(Assert.java:50)
	at org.apache.solr.BaseDistributedSearchTestCase.compareSolrResponses(BaseDistributedSearchTestCase.java:928)
	at org.apache.solr.BaseDistributedSearchTestCase.compareResponses(BaseDistributedSearchTestCase.java:955)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:613)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:589)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:568)
	at org.apache.solr.TestDistributedGrouping.test(TestDistributedGrouping.java:176)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1034)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:983)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13524 lines...]
   [junit4] Suite: org.apache.solr.TestDistributedGrouping
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_375390BEC5F87A6C-001/init-core-data-001
   [junit4]   2> 1709012 WARN  (SUITE-TestDistributedGrouping-seed#[375390BEC5F87A6C]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
   [junit4]   2> 1709012 INFO  (SUITE-TestDistributedGrouping-seed#[375390BEC5F87A6C]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1709013 INFO  (SUITE-TestDistributedGrouping-seed#[375390BEC5F87A6C]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1709013 INFO  (SUITE-TestDistributedGrouping-seed#[375390BEC5F87A6C]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1709013 INFO  (SUITE-TestDistributedGrouping-seed#[375390BEC5F87A6C]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /ofwc/
   [junit4]   2> 1709141 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_375390BEC5F87A6C-001/tempDir-001/control/cores/collection1
   [junit4]   2> 1709142 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 1709142 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1709142 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1709143 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1709144 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c323e37{/ofwc,null,AVAILABLE}
   [junit4]   2> 1709144 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5a28bf5c{HTTP/1.1,[http/1.1]}{127.0.0.1:44380}
   [junit4]   2> 1709145 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.Server Started @1710074ms
   [junit4]   2> 1709145 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/ofwc, hostPort=44380, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_375390BEC5F87A6C-001/tempDir-001/control/cores}
   [junit4]   2> 1709155 ERROR (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1709155 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1709155 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1709155 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 1709155 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1709155 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-07-24T01:09:22.945Z
   [junit4]   2> 1709155 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_375390BEC5F87A6C-001/tempDir-001/control/solr.xml
   [junit4]   2> 1709157 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1709157 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1709158 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9fddc6, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1709833 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1709833 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1709846 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9fddc6
   [junit4]   2> 1709852 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9fddc6
   [junit4]   2> 1709852 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9fddc6
   [junit4]   2> 1709853 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_375390BEC5F87A6C-001/tempDir-001/control/cores
   [junit4]   2> 1709853 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 1709855 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1709911 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1709936 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1709993 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1709999 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 1709999 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9fddc6
   [junit4]   2> 1710000 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1710000 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_375390BEC5F87A6C-001/tempDir-001/control/cores/collection1/data/]
   [junit4]   2> 1710000 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=29.138671875, floorSegmentMB=1.4736328125, forceMergeDeletesPctAllowed=25.969399958477673, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5733457668460538, deletesPctAllowed=27.631156395439138
   [junit4]   2> 1710051 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1710051 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1710052 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1710052 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1710052 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=44.4482421875, floorSegmentMB=1.6318359375, forceMergeDeletesPctAllowed=5.7191683901156045, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4642843307514396, deletesPctAllowed=23.980965504642683
   [junit4]   2> 1710053 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1caa7f27[collection1] main]
   [junit4]   2> 1710053 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 1710068 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 1710163 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1710163 INFO  (coreLoadExecutor-8113-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606832162291580928
   [junit4]   2> 1710163 INFO  (searcherExecutor-8114-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 1710164 INFO  (searcherExecutor-8114-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 1710164 INFO  (searcherExecutor-8114-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 1710164 INFO  (searcherExecutor-8114-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 1710164 INFO  (searcherExecutor-8114-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 1710164 INFO  (searcherExecutor-8114-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 1710164 INFO  (searcherExecutor-8114-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 1710165 INFO  (searcherExecutor-8114-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 1710165 INFO  (searcherExecutor-8114-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 1710165 INFO  (searcherExecutor-8114-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1caa7f27[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1710340 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_375390BEC5F87A6C-001/tempDir-001/shard0/cores/collection1
   [junit4]   2> 1710340 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 1710342 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1710342 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1710342 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1710342 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@681bd5c{/ofwc,null,AVAILABLE}
   [junit4]   2> 1710343 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6af4ef43{HTTP/1.1,[http/1.1]}{127.0.0.1:39687}
   [junit4]   2> 1710343 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.e.j.s.Server Started @1711273ms
   [junit4]   2> 1710343 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/ofwc, hostPort=39687, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_375390BEC5F87A6C-001/tempDir-001/shard0/cores}
   [junit4]   2> 1710343 ERROR (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1710343 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1710343 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1710344 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 1710344 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1710344 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-07-24T01:09:24.134Z
   [junit4]   2> 1710344 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_375390BEC5F87A6C-001/tempDir-001/shard0/solr.xml
   [junit4]   2> 1710348 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1710348 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1710348 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9fddc6, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1711559 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1711559 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1711577 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9fddc6
   [junit4]   2> 1711585 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9fddc6
   [junit4]   2> 1711585 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9fddc6
   [junit4]   2> 1711587 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_375390BEC5F87A6C-001/tempDir-001/shard0/cores
   [junit4]   2> 1711587 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 1711591 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1711647 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1711661 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1711734 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1711741 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 1711742 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c9fddc6
   [junit4]   2> 1711742 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1711742 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.TestDistributedGrouping_375390BEC5F87A6C-001/tempDir-001/shard0/cores/collection1/data/]
   [junit4]   2> 1711743 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=29.138671875, floorSegmentMB=1.4736328125, forceMergeDeletesPctAllowed=25.969399958477673, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5733457668460538, deletesPctAllowed=27.631156395439138
   [junit4]   2> 1711803 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1711803 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1711804 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1711804 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1711805 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=44.4482421875, floorSegmentMB=1.6318359375, forceMergeDeletesPctAllowed=5.7191683901156045, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4642843307514396, deletesPctAllowed=23.980965504642683
   [junit4]   2> 1711805 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@57884b13[collection1] main]
   [junit4]   2> 1711806 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 1711837 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 1711958 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1711958 INFO  (searcherExecutor-8128-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 1711958 INFO  (coreLoadExecutor-8127-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1606832164173774848
   [junit4]   2> 1711958 INFO  (searcherExecutor-8128-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 1711959 INFO  (searcherExecutor-8128-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 1711959 INFO  (searcherExecutor-8128-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 1711959 INFO  (searcherExecutor-8128-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 1711959 INFO  (searcherExecutor-8128-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 1711959 INFO  (searcherExecutor-8128-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 1711959 INFO  (searcherExecutor-8128-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 1711960 INFO  (searcherExecutor-8128-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 1711960 INFO  (searcherExecutor-8128-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@57884b13[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1712494 INFO  (TEST-TestDistributedGrouping.test-seed#[375390BEC5F87A6C]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 1712496 INFO  (qtp311381227-19614) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1606832164736860160)} 0 1
   [junit4]   2> 1712499 INFO  (qtp760234612-19637) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1606832164740005888)} 0 1
   [junit4]   2> 1712501 INFO  (qtp311381227-19613) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606832164743151616,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1712501 INFO  (qtp311381227-19613) [    x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1712501 INFO  (qtp311381227-19613) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1712501 INFO  (qtp311381227-19613) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 1
   [junit4]   2> 1712503 INFO  (qtp760234612-19633) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1606832164745248768,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1712503 INFO  (qtp760234612-19633) [    x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1712503 INFO  (qtp760234612-19633) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1712503 INFO  (qtp760234612-19633) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 1
   [junit4]   2> 1712504 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={q=*:*&distrib=false&fl=id,a_i1&group.limit=-1&sort=a_i1+asc,+id+asc&rows=100&wt=javabin&version=2&group.field=a_i1&group=true} hits=0 status=0 QTime=0
   [junit4]   2> 1712508 INFO  (qtp760234612-19638) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={df=text&group.distributed.first=true&distrib=false&fl=id&group.limit=-1&shards.purpose=2048&start=0&sort=a_i1+asc,+id+asc&shard.url=[ff01::213]:33332/ofwc|http://127.0.0.1:39687/ofwc/collection1|[ff01::083]:33332/ofwc|[ff01::114]:33332/ofwc&rows=100&version=2&q=*:*&NOW=1532394566294&isShard=true&wt=javabin&group.field=a_i1&group=true} status=0 QTime=0
   [junit4]   2> 1712508 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={q=*:*&shards=[ff01::213]:33332/ofwc|http://127.0.0.1:39687/ofwc/collection1|[ff01::083]:33332/ofwc|[ff01::114]:33332/ofwc&fl=id,a_i1&group.limit=-1&sort=a_i1+asc,+id+asc&rows=100&wt=javabin&version=2&group.field=a_i1&group=true} status=0 QTime=4
   [junit4]   2> 1712509 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={q=*:*&distrib=false&hl=true&fl=id,a_i1&group.limit=-1&sort=a_i1+asc,+id+asc&hl.fl=a_t&rows=100&wt=javabin&version=2&group.field=a_i1&group=true} hits=0 status=0 QTime=0
   [junit4]   2> 1712512 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={df=text&group.distributed.first=true&distrib=false&hl=false&fl=id&group.limit=-1&shards.purpose=2048&start=0&sort=a_i1+asc,+id+asc&shard.url=[ff01::114]:33332/ofwc|http://127.0.0.1:39687/ofwc/collection1&rows=100&version=2&q=*:*&NOW=1532394566300&isShard=true&hl.fl=a_t&wt=javabin&group.field=a_i1&group=true} status=0 QTime=0
   [junit4]   2> 1712512 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={q=*:*&shards=[ff01::114]:33332/ofwc|http://127.0.0.1:39687/ofwc/collection1&hl=true&fl=id,a_i1&group.limit=-1&sort=a_i1+asc,+id+asc&hl.fl=a_t&rows=100&wt=javabin&version=2&group.field=a_i1&group=true} status=0 QTime=2
   [junit4]   2> 1712513 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={q=*:*&facet.field=a_t&distrib=false&fl=id,a_i1&group.limit=-1&sort=a_i1+asc,+id+asc&rows=100&facet=true&wt=javabin&version=2&group.field=a_i1&group=true} hits=0 status=0 QTime=0
   [junit4]   2> 1712515 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={facet.field=a_t&df=text&group.distributed.first=true&distrib=false&fl=id&group.limit=-1&shards.purpose=2048&start=0&sort=a_i1+asc,+id+asc&shard.url=http://127.0.0.1:39687/ofwc/collection1|[ff01::114]:33332/ofwc|[ff01::083]:33332/ofwc|[ff01::213]:33332/ofwc&rows=100&version=2&q=*:*&NOW=1532394566303&isShard=true&facet=false&wt=javabin&group.field=a_i1&group=true} status=0 QTime=1
   [junit4]   2> 1712516 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={facet.field=a_t&df=text&distrib=false&fl=id&group.limit=-1&shards.purpose=20&start=0&f.a_t.facet.mincount=0&sort=a_i1+asc,+id+asc&shard.url=http://127.0.0.1:39687/ofwc/collection1|[ff01::114]:33332/ofwc|[ff01::083]:33332/ofwc|[ff01::213]:33332/ofwc&rows=100&version=2&group.distributed.second=true&q=*:*&f.a_t.facet.limit=160&NOW=1532394566303&isShard=true&facet=true&wt=javabin&group.field=a_i1&group=true} status=0 QTime=0
   [junit4]   2> 1712517 INFO  (qtp760234612-19638) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={q=*:*&shards=http://127.0.0.1:39687/ofwc/collection1|[ff01::114]:33332/ofwc|[ff01::083]:33332/ofwc|[ff01::213]:33332/ofwc&facet.field=a_t&fl=id,a_i1&group.limit=-1&sort=a_i1+asc,+id+asc&rows=100&facet=true&wt=javabin&version=2&group.field=a_i1&group=true} status=0 QTime=3
   [junit4]   2> 1712517 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={q=*:*&distrib=false&stats=true&fl=id,a_i1&group.limit=-1&sort=a_i1+asc,+id+asc&rows=100&wt=javabin&version=2&group.field=a_i1&group=true&stats.field=a_i1} hits=0 status=0 QTime=0
   [junit4]   2> 1712519 INFO  (qtp760234612-19638) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={df=text&group.distributed.first=true&distrib=false&fl=id&group.limit=-1&shards.purpose=2048&start=0&sort=a_i1+asc,+id+asc&shard.url=[ff01::083]:33332/ofwc|http://127.0.0.1:39687/ofwc/collection1&rows=100&version=2&q=*:*&stats=false&NOW=1532394566308&isShard=true&wt=javabin&group.field=a_i1&group=true&stats.field=a_i1} status=0 QTime=0
   [junit4]   2> 1712520 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={df=text&distrib=false&fl=id&group.limit=-1&shards.purpose=516&start=0&sort=a_i1+asc,+id+asc&shard.url=[ff01::083]:33332/ofwc|http://127.0.0.1:39687/ofwc/collection1&rows=100&version=2&group.distributed.second=true&q=*:*&stats=true&NOW=1532394566308&isShard=true&wt=javabin&group.field=a_i1&group=true&stats.field=a_i1} status=0 QTime=0
   [junit4]   2> 1712521 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={q=*:*&shards=[ff01::083]:33332/ofwc|http://127.0.0.1:39687/ofwc/collection1&stats=true&fl=id,a_i1&group.limit=-1&sort=a_i1+asc,+id+asc&rows=100&wt=javabin&version=2&group.field=a_i1&group=true&stats.field=a_i1} status=0 QTime=2
   [junit4]   2> 1712522 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={df=subject&distrib=false&qt=spellCheckCompRH&fl=id,a_i1&group.limit=-1&sort=a_i1+asc,+id+asc&rows=100&version=2&spellcheck.build=true&q=kings&spellcheck=true&wt=javabin&group.field=a_i1&group=true} hits=0 status=0 QTime=0
   [junit4]   2> 1712523 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={df=subject&group.distributed.first=true&distrib=false&qt=spellCheckCompRH&fl=id&group.limit=-1&shards.purpose=2048&start=0&sort=a_i1+asc,+id+asc&shard.url=[ff01::114]:33332/ofwc|http://127.0.0.1:39687/ofwc/collection1|[ff01::083]:33332/ofwc&rows=100&version=2&spellcheck.build=true&q=kings&spellcheck=true&NOW=1532394566312&isShard=true&wt=javabin&group.field=a_i1&group=true} status=0 QTime=0
   [junit4]   2> 1712523 INFO  (qtp760234612-19638) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={df=subject&qt=spellCheckCompRH&fl=id,a_i1&group.limit=-1&sort=a_i1+asc,+id+asc&rows=100&version=2&spellcheck.build=true&q=kings&shards=[ff01::114]:33332/ofwc|http://127.0.0.1:39687/ofwc/collection1|[ff01::083]:33332/ofwc&spellcheck=true&wt=javabin&group.field=a_i1&group=true} status=0 QTime=1
   [junit4]   2> 1712529 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={facet.field=a_t&distrib=false&fl=id,a_i1&group.limit=-1&fq=a_s:a&sort=a_i1+asc,+id+asc&rows=100&version=2&q=*:*&group.truncate=true&facet=true&wt=javabin&group.field=a_i1&group=true} hits=0 status=0 QTime=4
   [junit4]   2> 1712530 INFO  (qtp760234612-19638) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={facet.field=a_t&df=text&group.distributed.first=true&distrib=false&fl=id&group.limit=-1&shards.purpose=2048&start=0&fq=a_s:a&sort=a_i1+asc,+id+asc&shard.url=http://127.0.0.1:39687/ofwc/collection1|[ff01::213]:33332/ofwc|[ff01::114]:33332/ofwc&rows=100&version=2&q=*:*&group.truncate=true&NOW=1532394566319&isShard=true&facet=false&wt=javabin&group.field=a_i1&group=true} status=0 QTime=0
   [junit4]   2> 1712531 INFO  (qtp760234612-19638) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={facet.field=a_t&df=text&distrib=false&fl=id&group.limit=-1&shards.purpose=20&start=0&f.a_t.facet.mincount=0&fq=a_s:a&sort=a_i1+asc,+id+asc&shard.url=http://127.0.0.1:39687/ofwc/collection1|[ff01::213]:33332/ofwc|[ff01::114]:33332/ofwc&rows=100&version=2&group.distributed.second=true&q=*:*&f.a_t.facet.limit=160&group.truncate=true&NOW=1532394566319&isShard=true&facet=true&wt=javabin&group.field=a_i1&group=true} status=0 QTime=0
   [junit4]   2> 1712532 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/ofwc path=/select params={facet.field=a_t&fl=id,a_i1&group.limit=-1&fq=a_s:a&sort=a_i1+asc,+id+asc&rows=100&version=2&q=*:*&shards=http://127.0.0.1:39687/ofwc/collection1|[ff01::213]:33332/ofwc|[ff01::114]:33332/ofwc&group.truncate=true&facet=true&wt=javabin&group.field=a_i1&group=true} status=0 QTime=2
   [junit4]   2> 1712534 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[1 (1606832164775657472)]} 0 1
   [junit4]   2> 1712536 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[1 (1606832164777754624)]} 0 1
   [junit4]   2> 1712537 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[2 (1606832164779851776)]} 0 0
   [junit4]   2> 1712537 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[2 (1606832164780900352)]} 0 0
   [junit4]   2> 1712538 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[3 (1606832164781948928)]} 0 0
   [junit4]   2> 1712538 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[3 (1606832164781948928)]} 0 0
   [junit4]   2> 1712539 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[4 (1606832164782997504)]} 0 0
   [junit4]   2> 1712539 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[4 (1606832164782997504)]} 0 0
   [junit4]   2> 1712540 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[5 (1606832164784046080)]} 0 0
   [junit4]   2> 1712540 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[5 (1606832164784046080)]} 0 0
   [junit4]   2> 1712541 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[6 (1606832164785094656)]} 0 0
   [junit4]   2> 1712541 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[6 (1606832164785094656)]} 0 0
   [junit4]   2> 1712542 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[7 (1606832164785094657)]} 0 0
   [junit4]   2> 1712542 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[7 (1606832164786143232)]} 0 0
   [junit4]   2> 1712543 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[8 (1606832164787191808)]} 0 0
   [junit4]   2> 1712543 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[8 (1606832164787191808)]} 0 0
   [junit4]   2> 1712544 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[9 (1606832164787191809)]} 0 0
   [junit4]   2> 1712544 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[9 (1606832164788240384)]} 0 0
   [junit4]   2> 1712545 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[10 (1606832164788240384)]} 0 0
   [junit4]   2> 1712545 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[10 (1606832164789288960)]} 0 0
   [junit4]   2> 1712546 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[11 (1606832164789288960)]} 0 0
   [junit4]   2> 1712546 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[11 (1606832164790337536)]} 0 0
   [junit4]   2> 1712547 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[12 (1606832164791386112)]} 0 0
   [junit4]   2> 1712547 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[12 (1606832164791386112)]} 0 0
   [junit4]   2> 1712548 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[14 (1606832164792434688)]} 0 0
   [junit4]   2> 1712549 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[14 (1606832164793483264)]} 0 0
   [junit4]   2> 1712550 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[15 (1606832164793483264)]} 0 0
   [junit4]   2> 1712550 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[15 (1606832164794531840)]} 0 0
   [junit4]   2> 1712551 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[16 (1606832164795580416)]} 0 0
   [junit4]   2> 1712551 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[16 (1606832164795580416)]} 0 0
   [junit4]   2> 1712552 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[17 (1606832164796628992)]} 0 0
   [junit4]   2> 1712555 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[17 (1606832164799774720)]} 0 0
   [junit4]   2> 1712564 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[18 (1606832164808163328)]} 0 0
   [junit4]   2> 1712565 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[18 (1606832164810260480)]} 0 0
   [junit4]   2> 1712566 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[19 (1606832164811309056)]} 0 0
   [junit4]   2> 1712567 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[19 (1606832164811309056)]} 0 0
   [junit4]   2> 1712567 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[20 (1606832164812357632)]} 0 0
   [junit4]   2> 1712568 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[20 (1606832164813406208)]} 0 0
   [junit4]   2> 1712568 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[21 (1606832164813406208)]} 0 0
   [junit4]   2> 1712569 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[21 (1606832164814454784)]} 0 0
   [junit4]   2> 1712569 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[22 (1606832164814454784)]} 0 0
   [junit4]   2> 1712570 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[22 (1606832164815503360)]} 0 0
   [junit4]   2> 1712570 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[23 (1606832164815503360)]} 0 0
   [junit4]   2> 1712571 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[23 (1606832164816551936)]} 0 0
   [junit4]   2> 1712572 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[100 (1606832164816551936)]} 0 0
   [junit4]   2> 1712572 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[100 (1606832164817600512)]} 0 0
   [junit4]   2> 1712573 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[101 (1606832164817600512)]} 0 0
   [junit4]   2> 1712573 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[101 (1606832164818649088)]} 0 0
   [junit4]   2> 1712573 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[102 (1606832164818649088)]} 0 0
   [junit4]   2> 1712574 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[102 (1606832164819697664)]} 0 0
   [junit4]   2> 1712574 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[103 (1606832164819697664)]} 0 0
   [junit4]   2> 1712575 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[103 (1606832164820746240)]} 0 0
   [junit4]   2> 1712575 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[104 (1606832164820746240)]} 0 0
   [junit4]   2> 1712575 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[104 (1606832164820746241)]} 0 0
   [junit4]   2> 1712576 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[105 (1606832164821794816)]} 0 0
   [junit4]   2> 1712576 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[105 (1606832164821794816)]} 0 0
   [junit4]   2> 1712577 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[106 (1606832164822843392)]} 0 0
   [junit4]   2> 1712577 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[106 (1606832164822843392)]} 0 0
   [junit4]   2> 1712578 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[107 (1606832164822843393)]} 0 0
   [junit4]   2> 1712578 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[107 (1606832164823891968)]} 0 0
   [junit4]   2> 1712578 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[108 (1606832164823891968)]} 0 0
   [junit4]   2> 1712579 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[108 (1606832164824940544)]} 0 0
   [junit4]   2> 1712579 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[109 (1606832164824940544)]} 0 0
   [junit4]   2> 1712580 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[109 (1606832164825989120)]} 0 0
   [junit4]   2> 1712580 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[110 (1606832164825989120)]} 0 0
   [junit4]   2> 1712581 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[110 (1606832164827037696)]} 0 0
   [junit4]   2> 1712581 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[111 (1606832164827037696)]} 0 0
   [junit4]   2> 1712582 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[111 (1606832164828086272)]} 0 0
   [junit4]   2> 1712582 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[112 (1606832164828086272)]} 0 0
   [junit4]   2> 1712583 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[112 (1606832164828086273)]} 0 0
   [junit4]   2> 1712583 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[113 (1606832164829134848)]} 0 0
   [junit4]   2> 1712583 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[113 (1606832164829134848)]} 0 0
   [junit4]   2> 1712584 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[114 (1606832164830183424)]} 0 0
   [junit4]   2> 1712584 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[114 (1606832164830183424)]} 0 0
   [junit4]   2> 1712585 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[115 (1606832164831232000)]} 0 0
   [junit4]   2> 1712585 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[115 (1606832164831232000)]} 0 0
   [junit4]   2> 1712585 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[116 (1606832164831232001)]} 0 0
   [junit4]   2> 1712586 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[116 (1606832164832280576)]} 0 0
   [junit4]   2> 1712586 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[117 (1606832164832280576)]} 0 0
   [junit4]   2> 1712587 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[117 (1606832164833329152)]} 0 0
   [junit4]   2> 1712587 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[118 (1606832164833329152)]} 0 0
   [junit4]   2> 1712588 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[118 (1606832164834377728)]} 0 0
   [junit4]   2> 1712589 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[119 (1606832164835426304)]} 0 0
   [junit4]   2> 1712589 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[119 (1606832164835426304)]} 0 0
   [junit4]   2> 1712590 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[120 (1606832164835426305)]} 0 0
   [junit4]   2> 1712590 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[120 (1606832164836474880)]} 0 0
   [junit4]   2> 1712591 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[121 (1606832164837523456)]} 0 0
   [junit4]   2> 1712591 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[121 (1606832164837523456)]} 0 0
   [junit4]   2> 1712592 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[122 (1606832164838572032)]} 0 0
   [junit4]   2> 1712592 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[122 (1606832164838572032)]} 0 0
   [junit4]   2> 1712593 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[123 (1606832164838572033)]} 0 0
   [junit4]   2> 1712593 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[123 (1606832164839620608)]} 0 0
   [junit4]   2> 1712593 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[124 (1606832164839620608)]} 0 0
   [junit4]   2> 1712594 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[124 (1606832164840669184)]} 0 0
   [junit4]   2> 1712594 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[125 (1606832164840669184)]} 0 0
   [junit4]   2> 1712595 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[125 (1606832164841717760)]} 0 0
   [junit4]   2> 1712595 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[126 (1606832164841717760)]} 0 0
   [junit4]   2> 1712595 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[126 (1606832164841717761)]} 0 0
   [junit4]   2> 1712596 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[127 (1606832164842766336)]} 0 0
   [junit4]   2> 1712596 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[127 (1606832164842766336)]} 0 0
   [junit4]   2> 1712597 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[128 (1606832164843814912)]} 0 0
   [junit4]   2> 1712597 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[128 (1606832164843814912)]} 0 0
   [junit4]   2> 1712598 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[129 (1606832164844863488)]} 0 0
   [junit4]   2> 1712598 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[129 (1606832164844863488)]} 0 0
   [junit4]   2> 1712599 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[130 (1606832164845912064)]} 0 0
   [junit4]   2> 1712599 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[130 (1606832164845912064)]} 0 0
   [junit4]   2> 1712600 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[131 (1606832164846960640)]} 0 0
   [junit4]   2> 1712600 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[131 (1606832164846960640)]} 0 0
   [junit4]   2> 1712601 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[132 (1606832164848009216)]} 0 0
   [junit4]   2> 1712601 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[132 (1606832164848009216)]} 0 0
   [junit4]   2> 1712602 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[133 (1606832164849057792)]} 0 0
   [junit4]   2> 1712602 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[133 (1606832164849057792)]} 0 0
   [junit4]   2> 1712603 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[134 (1606832164850106368)]} 0 0
   [junit4]   2> 1712604 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[134 (1606832164850106368)]} 0 0
   [junit4]   2> 1712604 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[135 (1606832164851154944)]} 0 0
   [junit4]   2> 1712605 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[135 (1606832164852203520)]} 0 0
   [junit4]   2> 1712606 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[136 (1606832164853252096)]} 0 0
   [junit4]   2> 1712606 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[136 (1606832164853252096)]} 0 0
   [junit4]   2> 1712607 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[137 (1606832164854300672)]} 0 0
   [junit4]   2> 1712607 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[137 (1606832164854300672)]} 0 0
   [junit4]   2> 1712608 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[138 (1606832164855349248)]} 0 0
   [junit4]   2> 1712608 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[138 (1606832164855349248)]} 0 0
   [junit4]   2> 1712609 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[139 (1606832164856397824)]} 0 0
   [junit4]   2> 1712609 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[139 (1606832164856397824)]} 0 0
   [junit4]   2> 1712610 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[140 (1606832164856397825)]} 0 0
   [junit4]   2> 1712610 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[140 (1606832164857446400)]} 0 0
   [junit4]   2> 1712610 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[141 (1606832164857446400)]} 0 0
   [junit4]   2> 1712611 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[141 (1606832164858494976)]} 0 0
   [junit4]   2> 1712611 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[142 (1606832164858494976)]} 0 0
   [junit4]   2> 1712612 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[142 (1606832164859543552)]} 0 0
   [junit4]   2> 1712612 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[143 (1606832164859543552)]} 0 0
   [junit4]   2> 1712613 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[143 (1606832164860592128)]} 0 0
   [junit4]   2> 1712613 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[144 (1606832164860592128)]} 0 0
   [junit4]   2> 1712614 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[144 (1606832164861640704)]} 0 0
   [junit4]   2> 1712614 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[145 (1606832164861640704)]} 0 0
   [junit4]   2> 1712615 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[145 (1606832164861640705)]} 0 0
   [junit4]   2> 1712615 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[146 (1606832164862689280)]} 0 0
   [junit4]   2> 1712615 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[146 (1606832164862689280)]} 0 0
   [junit4]   2> 1712616 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[147 (1606832164863737856)]} 0 0
   [junit4]   2> 1712616 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[147 (1606832164863737856)]} 0 0
   [junit4]   2> 1712617 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[148 (1606832164864786432)]} 0 0
   [junit4]   2> 1712617 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[148 (1606832164864786432)]} 0 0
   [junit4]   2> 1712618 INFO  (qtp311381227-19620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[149 (1606832164865835008)]} 0 0
   [junit4]   2> 1712618 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[149 (1606832164865835008)]} 0 0
   [junit4]   2> 1712619 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[500 (1606832164866883584)]} 0 0
   [junit4]   2> 1712619 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[500 (1606832164866883584)]} 0 0
   [junit4]   2> 1712620 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[501 (1606832164867932160)]} 0 0
   [junit4]   2> 1712620 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[501 (1606832164867932160)]} 0 0
   [junit4]   2> 1712620 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[502 (1606832164867932161)]} 0 0
   [junit4]   2> 1712621 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[502 (1606832164868980736)]} 0 0
   [junit4]   2> 1712621 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[503 (1606832164868980736)]} 0 0
   [junit4]   2> 1712622 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[503 (1606832164868980737)]} 0 0
   [junit4]   2> 1712622 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[504 (1606832164870029312)]} 0 0
   [junit4]   2> 1712622 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[504 (1606832164870029312)]} 0 0
   [junit4]   2> 1712623 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[505 (1606832164870029313)]} 0 0
   [junit4]   2> 1712623 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[505 (1606832164871077888)]} 0 0
   [junit4]   2> 1712623 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[506 (1606832164871077888)]} 0 0
   [junit4]   2> 1712624 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[506 (1606832164871077889)]} 0 0
   [junit4]   2> 1712624 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[507 (1606832164872126464)]} 0 0
   [junit4]   2> 1712624 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[507 (1606832164872126464)]} 0 0
   [junit4]   2> 1712625 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[508 (1606832164873175040)]} 0 0
   [junit4]   2> 1712625 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[508 (1606832164873175040)]} 0 0
   [junit4]   2> 1712625 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[509 (1606832164873175041)]} 0 0
   [junit4]   2> 1712626 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[509 (1606832164874223616)]} 0 0
   [junit4]   2> 1712626 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[510 (1606832164874223616)]} 0 0
   [junit4]   2> 1712627 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[510 (1606832164874223617)]} 0 0
   [junit4]   2> 1712627 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[511 (1606832164875272192)]} 0 0
   [junit4]   2> 1712627 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[511 (1606832164875272192)]} 0 0
   [junit4]   2> 1712628 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[512 (1606832164876320768)]} 0 0
   [junit4]   2> 1712628 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[512 (1606832164876320768)]} 0 0
   [junit4]   2> 1712628 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[513 (1606832164876320769)]} 0 0
   [junit4]   2> 1712629 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[513 (1606832164877369344)]} 0 0
   [junit4]   2> 1712629 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[514 (1606832164877369344)]} 0 0
   [junit4]   2> 1712629 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[514 (1606832164877369345)]} 0 0
   [junit4]   2> 1712630 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[515 (1606832164878417920)]} 0 0
   [junit4]   2> 1712630 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[515 (1606832164878417920)]} 0 0
   [junit4]   2> 1712631 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[516 (1606832164878417921)]} 0 0
   [junit4]   2> 1712631 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[516 (1606832164879466496)]} 0 0
   [junit4]   2> 1712631 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[517 (1606832164879466496)]} 0 0
   [junit4]   2> 1712632 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[517 (1606832164880515072)]} 0 0
   [junit4]   2> 1712632 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[518 (1606832164880515072)]} 0 0
   [junit4]   2> 1712633 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[518 (1606832164881563648)]} 0 0
   [junit4]   2> 1712633 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[519 (1606832164881563648)]} 0 0
   [junit4]   2> 1712633 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[519 (1606832164881563649)]} 0 0
   [junit4]   2> 1712634 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[520 (1606832164882612224)]} 0 0
   [junit4]   2> 1712634 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[520 (1606832164882612224)]} 0 0
   [junit4]   2> 1712634 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[521 (1606832164882612225)]} 0 0
   [junit4]   2> 1712635 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[521 (1606832164883660800)]} 0 0
   [junit4]   2> 1712635 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[522 (1606832164883660800)]} 0 0
   [junit4]   2> 1712635 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[522 (1606832164883660801)]} 0 0
   [junit4]   2> 1712636 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[523 (1606832164884709376)]} 0 0
   [junit4]   2> 1712636 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[523 (1606832164884709376)]} 0 0
   [junit4]   2> 1712636 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[524 (1606832164884709377)]} 0 0
   [junit4]   2> 1712637 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[524 (1606832164885757952)]} 0 0
   [junit4]   2> 1712637 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[525 (1606832164885757952)]} 0 0
   [junit4]   2> 1712638 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[525 (1606832164885757953)]} 0 0
   [junit4]   2> 1712638 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[526 (1606832164886806528)]} 0 0
   [junit4]   2> 1712639 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[526 (1606832164887855104)]} 0 0
   [junit4]   2> 1712639 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[527 (1606832164887855104)]} 0 0
   [junit4]   2> 1712639 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[527 (1606832164887855105)]} 0 0
   [junit4]   2> 1712640 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[528 (1606832164888903680)]} 0 0
   [junit4]   2> 1712640 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[528 (1606832164888903680)]} 0 0
   [junit4]   2> 1712640 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[529 (1606832164888903681)]} 0 0
   [junit4]   2> 1712641 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[529 (1606832164889952256)]} 0 0
   [junit4]   2> 1712641 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[530 (1606832164889952256)]} 0 0
   [junit4]   2> 1712641 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[530 (1606832164889952257)]} 0 0
   [junit4]   2> 1712642 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[531 (1606832164891000832)]} 0 0
   [junit4]   2> 1712642 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[531 (1606832164891000832)]} 0 0
   [junit4]   2> 1712642 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[532 (1606832164891000833)]} 0 0
   [junit4]   2> 1712643 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[532 (1606832164892049408)]} 0 0
   [junit4]   2> 1712643 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[533 (1606832164892049408)]} 0 0
   [junit4]   2> 1712644 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[533 (1606832164892049409)]} 0 0
   [junit4]   2> 1712644 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[534 (1606832164893097984)]} 0 0
   [junit4]   2> 1712644 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[534 (1606832164893097984)]} 0 0
   [junit4]   2> 1712645 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[535 (1606832164893097985)]} 0 0
   [junit4]   2> 1712645 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[535 (1606832164894146560)]} 0 0
   [junit4]   2> 1712645 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[536 (1606832164894146560)]} 0 0
   [junit4]   2> 1712646 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[536 (1606832164894146561)]} 0 0
   [junit4]   2> 1712646 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[537 (1606832164895195136)]} 0 0
   [junit4]   2> 1712646 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[537 (1606832164895195136)]} 0 0
   [junit4]   2> 1712647 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[538 (1606832164896243712)]} 0 0
   [junit4]   2> 1712647 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[538 (1606832164896243712)]} 0 0
   [junit4]   2> 1712647 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[539 (1606832164896243713)]} 0 0
   [junit4]   2> 1712648 INFO  (qtp760234612-19636) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[539 (1606832164897292288)]} 0 0
   [junit4]   2> 1712648 INFO  (qtp311381227-19617) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[540 (1606832164897292288)]} 0 0
   [junit4]   2> 1712648 INFO  (qtp760234612-19639) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/ofwc path=/update params={wt=javabin&version=2}{add=[540 (160683216489729228

[...truncated too long message...]

actory, TestCloudConsistency, ReplicationFactorTest, DirectUpdateHandlerTest, CleanupOldIndexTest, TestIndexSearcher, TestAddFieldRealTimeGet, SolrTestCaseJ4Test, ZkStateWriterTest, SecurityConfHandlerTest, TestRandomDVFaceting, SliceStateTest, TestCoreContainer, CollectionPropsTest, PKIAuthenticationIntegrationTest, TestAnalyzedSuggestions, TestZkAclsWithHadoopAuth, UUIDFieldTest, TestMissingGroups, InfixSuggestersTest, TestSerializedLuceneMatchVersion, MetricsHistoryHandlerTest, TestPrepRecovery, TestDocBasedVersionConstraints, TestExportWriter, HdfsWriteToMultipleCollectionsTest, UpdateRequestProcessorFactoryTest, TestFieldTypeCollectionResource, LeaderFailoverAfterPartitionTest, CollectionReloadTest, PluginInfoTest, NotRequiredUniqueKeyTest, TransactionLogTest, SmileWriterTest, TestFieldCollectionResource, TestReplicationHandler, TestEmbeddedSolrServerAdminHandler, TestSchemaNameResource, CursorMarkTest, TestManagedSynonymGraphFilterFactory, TestSystemCollAutoCreate, TestRandomCollapseQParserPlugin, ShowFileRequestHandlerTest, ForceLeaderTest, SolrCoreCheckLockOnStartupTest, TestSolrQueryParser, SpellingQueryConverterTest, PrimUtilsTest, DistributedFacetExistsSmallTest, ResourceLoaderTest, TestLeaderInitiatedRecoveryThread, DirectSolrSpellCheckerTest, TestQueryUtils, ScriptEngineTest, CurrencyFieldTypeTest, TestSolrCloudWithDelegationTokens, BlockJoinFacetSimpleTest, TestGraphTermsQParserPlugin, TestSha256AuthenticationProvider, MoveReplicaHDFSFailoverTest, TestSizeLimitedDistributedMap, OutOfBoxZkACLAndCredentialsProvidersTest, NodeLostTriggerTest, TestSimDistributedQueue, TestDistribIDF, CollectionsAPIAsyncDistributedZkTest, TestExclusionRuleCollectionAccess, HighlighterMaxOffsetTest, MetricTriggerTest, DistanceFunctionTest, PrimitiveFieldTypeTest, VMParamsZkACLAndCredentialsProvidersTest, TestHdfsUpdateLog, TestConfigSetsAPIZkFailure, TestExpandComponent, TestStressUserVersions, TestFieldCacheVsDocValues, NoCacheHeaderTest, TestReversedWildcardFilterFactory, BasicDistributedZk2Test, RuleEngineTest, TestCloudPseudoReturnFields, CursorPagingTest, TestTlogReplica, LegacyCloudClusterPropTest, TestCursorMarkWithoutUniqueKey, TestCodecSupport, ConfigureRecoveryStrategyTest, TestSolrFieldCacheBean, TestRequestStatusCollectionAPI, TolerantUpdateProcessorTest, ReplicaListTransformerTest, RecoveryZkTest, TestFieldSortValues, EnumFieldTest, CoreMergeIndexesAdminHandlerTest, BlockJoinFacetDistribTest, CloneFieldUpdateProcessorFactoryTest, TestNodeLostTrigger, TestBulkSchemaConcurrent, HdfsCollectionsAPIDistributedZkTest, ExplicitHLLTest, TestUseDocValuesAsStored, DOMUtilTest, DocValuesMultiTest, TestMultiValuedNumericRangeQuery, TestRequestForwarding, TestReqParamsAPI, TestJavabinTupleStreamParser, SaslZkACLProviderTest, RestoreTriggerStateTest, DeleteNodeTest, TestComplexPhraseLeadingWildcard, CdcrUpdateLogTest, PathHierarchyTokenizerFactoryTest, CustomHighlightComponentTest, TestLegacyField, UUIDUpdateProcessorFallbackTest, SynonymTokenizerTest, DistribCursorPagingTest, CdcrVersionReplicationTest, TestPushWriter, TestFieldCache, TestValueSourceCache, TestQuerySenderListener, TestSurroundQueryParser, WordBreakSolrSpellCheckerTest, DirectSolrConnectionTest, TestCloudSearcherWarming, TriLevelCompositeIdRoutingTest, TestCSVLoader, SampleTest, TestDocTermOrds, TestMergePolicyConfig, CoreAdminOperationTest, TestDFRSimilarityFactory, HdfsBasicDistributedZk2Test, TestCoreBackup, TestTolerantSearch, SolrCloudExampleTest, TestLocalFSCloudBackupRestore, TestComponentsName, TestCloudInspectUtil, NumberUtilsTest, SolrRrdBackendFactoryTest, SchemaApiFailureTest, EmbeddedSolrNoSerializeTest, TestNumericTerms64, TestComputePlanAction, TestNoOpRegenerator, AlternateDirectoryTest, SortSpecParsingTest, PeerSyncWithLeaderAndIndexFingerprintCachingTest, HdfsSyncSliceTest, TestSolrCloudWithSecureImpersonation, TriggerSetPropertiesIntegrationTest, TestSmileRequest, TestMiniSolrCloudClusterSSL, TestCollationFieldDocValues, HdfsChaosMonkeyNothingIsSafeTest, AtomicUpdatesTest, AddReplicaTest, BasicFunctionalityTest, DisMaxRequestHandlerTest, DistributedIntervalFacetingTest, EchoParamsTest, SolrInfoBeanTest, TestCrossCoreJoin, TestDistributedGrouping]
   [junit4] Completed [380/825 (1!)] on J1 in 3.92s, 1 test, 1 failure <<< FAILURES!

[...truncated 46765 lines...]
-ecj-javadoc-lint-tests:
    [mkdir] Created dir: /var/tmp/ecj1307894121
 [ecj-lint] Compiling 923 source files to /var/tmp/ecj1307894121
 [ecj-lint] invalid Class-Path header in manifest of jar file: /export/home/jenkins/.ivy2/cache/org.restlet.jee/org.restlet/jars/org.restlet-2.3.0.jar
 [ecj-lint] invalid Class-Path header in manifest of jar file: /export/home/jenkins/.ivy2/cache/org.restlet.jee/org.restlet.ext.servlet/jars/org.restlet.ext.servlet-2.3.0.jar
 [ecj-lint] ----------
 [ecj-lint] 1. WARNING in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test/org/apache/solr/analysis/TokenizerChainTest.java (at line 37)
 [ecj-lint] 	TokenizerChain tokenizerChain = new TokenizerChain(
 [ecj-lint] 	               ^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'tokenizerChain' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 2. WARNING in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test/org/apache/solr/cloud/autoscaling/sim/SimCloudManager.java (at line 690)
 [ecj-lint] 	throw new UnsupportedOperationException("must add at least 1 node first");
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'queryRequest' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] 3. WARNING in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test/org/apache/solr/cloud/autoscaling/sim/SimCloudManager.java (at line 696)
 [ecj-lint] 	throw new UnsupportedOperationException("must add at least 1 node first");
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'queryRequest' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 4. ERROR in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test/org/apache/solr/handler/export/TestExportWriter.java (at line 34)
 [ecj-lint] 	import org.apache.solr.common.params.CommonParams;
 [ecj-lint] 	       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The import org.apache.solr.common.params.CommonParams is never used
 [ecj-lint] ----------
 [ecj-lint] 5. ERROR in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test/org/apache/solr/handler/export/TestExportWriter.java (at line 38)
 [ecj-lint] 	import org.apache.solr.response.ResultContext;
 [ecj-lint] 	       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The import org.apache.solr.response.ResultContext is never used
 [ecj-lint] ----------
 [ecj-lint] 6. ERROR in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test/org/apache/solr/handler/export/TestExportWriter.java (at line 39)
 [ecj-lint] 	import org.apache.solr.response.SolrQueryResponse;
 [ecj-lint] 	       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The import org.apache.solr.response.SolrQueryResponse is never used
 [ecj-lint] ----------
 [ecj-lint] 7. ERROR in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test/org/apache/solr/handler/export/TestExportWriter.java (at line 41)
 [ecj-lint] 	import org.apache.solr.search.DocIterator;
 [ecj-lint] 	       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The import org.apache.solr.search.DocIterator is never used
 [ecj-lint] ----------
 [ecj-lint] 8. ERROR in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test/org/apache/solr/handler/export/TestExportWriter.java (at line 42)
 [ecj-lint] 	import org.apache.solr.search.DocList;
 [ecj-lint] 	       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The import org.apache.solr.search.DocList is never used
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 9. WARNING in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test/org/apache/solr/update/processor/DistributedUpdateProcessorTest.java (at line 39)
 [ecj-lint] 	DistributedUpdateProcessor processor = new DistributedUpdateProcessor(
 [ecj-lint] 	                           ^^^^^^^^^
 [ecj-lint] Resource leak: 'processor' is never closed
 [ecj-lint] ----------
 [ecj-lint] 9 problems (5 errors, 4 warnings)

BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/build.xml:633: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/build.xml:101: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build.xml:690: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:2093: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:2126: Compile failed; see the compiler error output for details.

Total time: 99 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2